2026-02-12T22:22:27.524 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:22:27.541 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:22:27.623 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47187 branch: wip-pdonnell-testing-20260210.171210 description: fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds-flush} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47187' kernel: client: sha1: distro sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: syntax: v2 selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJzG3/6pJcxrRS5OP2PrIq3vtpcEqbE+CIgIkXWNZ6fJYGTQGSXp6J6EGtnOIVWqlQLofP+LXieJ/lnAQHPc1kc= trial158.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA0GhgCBLIQ2BPe/DtcSWciwhlpqaQtCfLTAJ45iGblZw8tGjrgb4CsrgGvIuM+Rpy1AT/63xB9/cQH0FGbVM3M= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - cephfs_test_runner: modules: - tasks.cephfs.test_flush teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:22:27.623 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:22:27.623 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:22:27.623 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:22:27.625 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:22:27.625 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:22:27.625 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:22:27.625 INFO:teuthology.packaging:ref: None 2026-02-12T22:22:27.625 INFO:teuthology.packaging:tag: None 2026-02-12T22:22:27.625 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:22:27.625 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:22:27.625 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:22:27.742 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:22:27.743 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:22:27.754 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:22:27.755 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:22:27.768 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:22:27.777 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:22:27.788 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:22:27.843 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial138.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47187', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:19:04.156511', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJzG3/6pJcxrRS5OP2PrIq3vtpcEqbE+CIgIkXWNZ6fJYGTQGSXp6J6EGtnOIVWqlQLofP+LXieJ/lnAQHPc1kc='} 2026-02-12T22:22:27.898 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial158.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47187', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:19:04.157134', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA0GhgCBLIQ2BPe/DtcSWciwhlpqaQtCfLTAJ45iGblZw8tGjrgb4CsrgGvIuM+Rpy1AT/63xB9/cQH0FGbVM3M='} 2026-02-12T22:22:27.898 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:22:27.909 INFO:teuthology.task.internal:roles: ubuntu@trial138.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2026-02-12T22:22:27.909 INFO:teuthology.task.internal:roles: ubuntu@trial158.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2026-02-12T22:22:27.909 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:22:28.039 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7a0327ab22a0>, signals=[15]) 2026-02-12T22:22:28.040 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:22:28.053 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:22:28.053 DEBUG:teuthology.task.internal:connecting to ubuntu@trial138.front.sepia.ceph.com 2026-02-12T22:22:28.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:22:28.115 DEBUG:teuthology.task.internal:connecting to ubuntu@trial158.front.sepia.ceph.com 2026-02-12T22:22:28.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:22:28.175 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:22:28.186 DEBUG:teuthology.orchestra.run.trial138:> uname -m 2026-02-12T22:22:28.202 INFO:teuthology.orchestra.run.trial138.stdout:x86_64 2026-02-12T22:22:28.203 DEBUG:teuthology.orchestra.run.trial138:> cat /etc/os-release 2026-02-12T22:22:28.260 INFO:teuthology.orchestra.run.trial138.stdout:NAME="Rocky Linux" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:ID="rocky" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:VERSION_ID="10.1" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:ANSI_COLOR="0;32" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:VENDOR_NAME="RESF" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:22:28.261 INFO:teuthology.orchestra.run.trial138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:22:28.261 INFO:teuthology.lock.ops:Updating trial138.front.sepia.ceph.com on lock server 2026-02-12T22:22:28.318 DEBUG:teuthology.orchestra.run.trial158:> uname -m 2026-02-12T22:22:28.335 INFO:teuthology.orchestra.run.trial158.stdout:x86_64 2026-02-12T22:22:28.335 DEBUG:teuthology.orchestra.run.trial158:> cat /etc/os-release 2026-02-12T22:22:28.392 INFO:teuthology.orchestra.run.trial158.stdout:NAME="Rocky Linux" 2026-02-12T22:22:28.392 INFO:teuthology.orchestra.run.trial158.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:22:28.392 INFO:teuthology.orchestra.run.trial158.stdout:ID="rocky" 2026-02-12T22:22:28.392 INFO:teuthology.orchestra.run.trial158.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:22:28.392 INFO:teuthology.orchestra.run.trial158.stdout:VERSION_ID="10.1" 2026-02-12T22:22:28.392 INFO:teuthology.orchestra.run.trial158.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:22:28.392 INFO:teuthology.orchestra.run.trial158.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:22:28.392 INFO:teuthology.orchestra.run.trial158.stdout:ANSI_COLOR="0;32" 2026-02-12T22:22:28.392 INFO:teuthology.orchestra.run.trial158.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:22:28.392 INFO:teuthology.orchestra.run.trial158.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:22:28.392 INFO:teuthology.orchestra.run.trial158.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:22:28.392 INFO:teuthology.orchestra.run.trial158.stdout:VENDOR_NAME="RESF" 2026-02-12T22:22:28.392 INFO:teuthology.orchestra.run.trial158.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:22:28.392 INFO:teuthology.orchestra.run.trial158.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:22:28.393 INFO:teuthology.orchestra.run.trial158.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:22:28.393 INFO:teuthology.orchestra.run.trial158.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:22:28.393 INFO:teuthology.orchestra.run.trial158.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:22:28.393 INFO:teuthology.orchestra.run.trial158.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:22:28.393 INFO:teuthology.orchestra.run.trial158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:22:28.393 INFO:teuthology.lock.ops:Updating trial158.front.sepia.ceph.com on lock server 2026-02-12T22:22:28.449 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:22:28.461 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:22:28.471 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:22:28.471 DEBUG:teuthology.orchestra.run.trial138:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:22:28.473 DEBUG:teuthology.orchestra.run.trial158:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:22:28.489 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:22:28.500 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:22:28.500 DEBUG:teuthology.orchestra.run.trial138:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:22:28.529 DEBUG:teuthology.orchestra.run.trial158:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:22:28.544 INFO:teuthology.orchestra.run.trial138.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:22:28.546 INFO:teuthology.orchestra.run.trial158.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:22:28.547 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:22:28.669 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:22:28.687 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'sha1': 'distro'} 2026-02-12T22:22:28.688 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2026-02-12T22:22:28.688 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:22:28.688 DEBUG:teuthology.orchestra.run.trial138:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:22:28.688 DEBUG:teuthology.orchestra.run.trial158:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:22:28.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:22:28.704 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:22:28.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:22:28.704 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:22:28.760 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:22:28.760 INFO:teuthology.task.kernel:Running kernel on trial138: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:22:28.760 DEBUG:teuthology.orchestra.run.trial138:> sudo yum install -y kernel 2026-02-12T22:22:28.761 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:22:28.761 INFO:teuthology.task.kernel:Running kernel on trial158: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:22:28.761 DEBUG:teuthology.orchestra.run.trial158:> sudo yum install -y kernel 2026-02-12T22:22:29.291 INFO:teuthology.orchestra.run.trial138.stdout:Rocky Linux 10 - AppStream 17 MB/s | 2.2 MB 00:00 2026-02-12T22:22:29.293 INFO:teuthology.orchestra.run.trial158.stdout:Rocky Linux 10 - AppStream 17 MB/s | 2.2 MB 00:00 2026-02-12T22:22:29.626 INFO:teuthology.orchestra.run.trial138.stdout:Rocky Linux 10 - BaseOS 52 MB/s | 11 MB 00:00 2026-02-12T22:22:29.635 INFO:teuthology.orchestra.run.trial158.stdout:Rocky Linux 10 - BaseOS 51 MB/s | 11 MB 00:00 2026-02-12T22:22:30.117 INFO:teuthology.orchestra.run.trial158.stdout:Rocky Linux 10 - CRB 6.7 MB/s | 507 kB 00:00 2026-02-12T22:22:30.142 INFO:teuthology.orchestra.run.trial138.stdout:Rocky Linux 10 - CRB 4.5 MB/s | 507 kB 00:00 2026-02-12T22:22:30.454 INFO:teuthology.orchestra.run.trial158.stdout:Extra Packages for Enterprise Linux 22 MB/s | 6.2 MB 00:00 2026-02-12T22:22:31.116 INFO:teuthology.orchestra.run.trial158.stdout:lab-extras 316 kB/s | 3.7 kB 00:00 2026-02-12T22:22:31.424 INFO:teuthology.orchestra.run.trial138.stdout:Extra Packages for Enterprise Linux 5.0 MB/s | 6.2 MB 00:01 2026-02-12T22:22:31.527 INFO:teuthology.orchestra.run.trial158.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:22:31.539 INFO:teuthology.orchestra.run.trial158.stdout:Dependencies resolved. 2026-02-12T22:22:31.540 INFO:teuthology.orchestra.run.trial158.stdout:================================================================================ 2026-02-12T22:22:31.540 INFO:teuthology.orchestra.run.trial158.stdout: Package Arch Version Repo Size 2026-02-12T22:22:31.540 INFO:teuthology.orchestra.run.trial158.stdout:================================================================================ 2026-02-12T22:22:31.540 INFO:teuthology.orchestra.run.trial158.stdout:Installing: 2026-02-12T22:22:31.540 INFO:teuthology.orchestra.run.trial158.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:22:31.541 INFO:teuthology.orchestra.run.trial158.stdout:Installing dependencies: 2026-02-12T22:22:31.541 INFO:teuthology.orchestra.run.trial158.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:22:31.541 INFO:teuthology.orchestra.run.trial158.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:22:31.541 INFO:teuthology.orchestra.run.trial158.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:22:31.541 INFO:teuthology.orchestra.run.trial158.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:22:31.541 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-12T22:22:31.541 INFO:teuthology.orchestra.run.trial158.stdout:Transaction Summary 2026-02-12T22:22:31.541 INFO:teuthology.orchestra.run.trial158.stdout:================================================================================ 2026-02-12T22:22:31.541 INFO:teuthology.orchestra.run.trial158.stdout:Install 5 Packages 2026-02-12T22:22:31.541 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-12T22:22:31.541 INFO:teuthology.orchestra.run.trial158.stdout:Total download size: 93 M 2026-02-12T22:22:31.542 INFO:teuthology.orchestra.run.trial158.stdout:Installed size: 135 M 2026-02-12T22:22:31.542 INFO:teuthology.orchestra.run.trial158.stdout:Downloading Packages: 2026-02-12T22:22:31.600 INFO:teuthology.orchestra.run.trial158.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2026-02-12T22:22:31.818 INFO:teuthology.orchestra.run.trial158.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 67 MB/s | 18 MB 00:00 2026-02-12T22:22:31.886 INFO:teuthology.orchestra.run.trial158.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 41 MB/s | 2.8 MB 00:00 2026-02-12T22:22:32.070 INFO:teuthology.orchestra.run.trial158.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 63 MB/s | 30 MB 00:00 2026-02-12T22:22:32.073 INFO:teuthology.orchestra.run.trial138.stdout:lab-extras 318 kB/s | 3.7 kB 00:00 2026-02-12T22:22:32.269 INFO:teuthology.orchestra.run.trial158.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 56 MB/s | 41 MB 00:00 2026-02-12T22:22:32.270 INFO:teuthology.orchestra.run.trial158.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:22:32.270 INFO:teuthology.orchestra.run.trial158.stdout:Total 127 MB/s | 93 MB 00:00 2026-02-12T22:22:32.270 INFO:teuthology.orchestra.run.trial158.stdout:Running transaction check 2026-02-12T22:22:32.414 INFO:teuthology.orchestra.run.trial158.stdout:Transaction check succeeded. 2026-02-12T22:22:32.414 INFO:teuthology.orchestra.run.trial158.stdout:Running transaction test 2026-02-12T22:22:32.480 INFO:teuthology.orchestra.run.trial138.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:22:32.492 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-12T22:22:32.493 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-12T22:22:32.493 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-12T22:22:32.493 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-12T22:22:32.493 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-12T22:22:32.493 INFO:teuthology.orchestra.run.trial138.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:22:32.493 INFO:teuthology.orchestra.run.trial138.stdout:Installing dependencies: 2026-02-12T22:22:32.493 INFO:teuthology.orchestra.run.trial138.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:22:32.493 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:22:32.494 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:22:32.494 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:22:32.494 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-12T22:22:32.494 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-12T22:22:32.494 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-12T22:22:32.494 INFO:teuthology.orchestra.run.trial138.stdout:Install 5 Packages 2026-02-12T22:22:32.494 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-12T22:22:32.494 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 93 M 2026-02-12T22:22:32.494 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 135 M 2026-02-12T22:22:32.494 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-12T22:22:32.541 INFO:teuthology.orchestra.run.trial138.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 29 MB/s | 1.4 MB 00:00 2026-02-12T22:22:32.751 INFO:teuthology.orchestra.run.trial138.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 72 MB/s | 18 MB 00:00 2026-02-12T22:22:32.797 INFO:teuthology.orchestra.run.trial138.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 61 MB/s | 2.8 MB 00:00 2026-02-12T22:22:32.816 INFO:teuthology.orchestra.run.trial158.stdout:Transaction test succeeded. 2026-02-12T22:22:32.816 INFO:teuthology.orchestra.run.trial158.stdout:Running transaction 2026-02-12T22:22:33.077 INFO:teuthology.orchestra.run.trial138.stdout:(4/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 70 MB/s | 41 MB 00:00 2026-02-12T22:22:33.514 INFO:teuthology.orchestra.run.trial158.stdout: Preparing : 1/1 2026-02-12T22:22:33.715 INFO:teuthology.orchestra.run.trial158.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:22:33.736 INFO:teuthology.orchestra.run.trial158.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:22:34.995 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:22:35.023 INFO:teuthology.orchestra.run.trial158.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:22:35.402 INFO:teuthology.orchestra.run.trial138.stdout:(5/5): kernel-modules-core-6.12.0-124.31.1.el10 10 MB/s | 30 MB 00:02 2026-02-12T22:22:35.403 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:22:35.403 INFO:teuthology.orchestra.run.trial138.stdout:Total 32 MB/s | 93 MB 00:02 2026-02-12T22:22:35.403 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-12T22:22:35.549 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-12T22:22:35.549 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-12T22:22:35.951 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-12T22:22:35.951 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-12T22:22:36.643 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-12T22:22:36.844 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:22:36.862 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:22:36.865 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:22:36.868 INFO:teuthology.orchestra.run.trial158.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:22:38.124 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:22:38.152 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:22:38.726 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:22:38.735 INFO:teuthology.orchestra.run.trial158.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:22:40.002 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:22:40.008 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:22:40.595 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:22:41.875 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:22:41.885 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:22:43.752 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:23:14.250 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:23:14.272 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:23:14.502 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:23:14.502 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-12T22:23:14.502 INFO:teuthology.orchestra.run.trial158.stdout:Installed: 2026-02-12T22:23:14.502 INFO:teuthology.orchestra.run.trial158.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:14.502 INFO:teuthology.orchestra.run.trial158.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:14.502 INFO:teuthology.orchestra.run.trial158.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:14.502 INFO:teuthology.orchestra.run.trial158.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:14.502 INFO:teuthology.orchestra.run.trial158.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:14.502 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-12T22:23:14.502 INFO:teuthology.orchestra.run.trial158.stdout:Complete! 2026-02-12T22:23:14.565 DEBUG:teuthology.orchestra.run.trial158:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:23:14.640 INFO:teuthology.orchestra.run.trial158.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:14.641 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:14.641 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:14.641 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:23:14.641 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:23:14.641 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2026-02-12T22:23:14.642 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial158.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:23:14.642 DEBUG:teuthology.orchestra.run.trial158:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:23:14.713 INFO:teuthology.orchestra.run.trial158.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:14.715 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:14.715 DEBUG:teuthology.orchestra.run.trial158:> sudo rpm -qi grub2-tools 2026-02-12T22:23:14.789 INFO:teuthology.orchestra.run.trial158.stdout:Name : grub2-tools 2026-02-12T22:23:14.789 INFO:teuthology.orchestra.run.trial158.stdout:Epoch : 1 2026-02-12T22:23:14.789 INFO:teuthology.orchestra.run.trial158.stdout:Version : 2.12 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:Release : 29.el10_1 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:Architecture: x86_64 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:Group : Unspecified 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:Size : 7963769 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:License : GPL-3.0-or-later 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:Signature : 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:Packager : Release Engineering 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:Summary : Support tools for GRUB. 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:Description : 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:23:14.790 INFO:teuthology.orchestra.run.trial158.stdout:hardware devices. 2026-02-12T22:23:14.791 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-12T22:23:14.791 INFO:teuthology.orchestra.run.trial158.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:23:14.791 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:23:14.791 INFO:teuthology.task.kernel:Updating grub on trial158 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:14.791 DEBUG:teuthology.orchestra.run.trial158:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:23:14.858 INFO:teuthology.orchestra.run.trial158.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:23:14.860 DEBUG:teuthology.orchestra.run.trial158:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:23:14.926 INFO:teuthology.orchestra.run.trial158.stdout:/sbin/grubby 2026-02-12T22:23:14.928 INFO:teuthology.orchestra.run.trial158.stdout:yes 2026-02-12T22:23:14.928 DEBUG:teuthology.orchestra.run.trial158:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:23:14.995 INFO:teuthology.orchestra.run.trial158.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:23:14.996 DEBUG:teuthology.orchestra.run.trial158:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:15.073 DEBUG:teuthology.orchestra.run.trial158:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:23:15.186 INFO:teuthology.orchestra.run.trial158.stderr:Generating grub configuration file ... 2026-02-12T22:23:15.364 INFO:teuthology.orchestra.run.trial158.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:23:15.373 INFO:teuthology.orchestra.run.trial158.stderr:done 2026-02-12T22:23:15.375 DEBUG:teuthology.orchestra.run.trial158:> test -d /sys/firmware/efi 2026-02-12T22:23:15.392 DEBUG:teuthology.orchestra.run.trial158:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:23:15.465 INFO:teuthology.orchestra.run.trial158.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:23:15.465 INFO:teuthology.orchestra.run.trial158.stdout:/boot/efi/EFI/rocky 2026-02-12T22:23:15.466 DEBUG:teuthology.orchestra.run.trial158:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:23:15.534 INFO:teuthology.orchestra.run.trial158.stdout:no 2026-02-12T22:23:15.535 DEBUG:teuthology.orchestra.run.trial158:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:23:15.601 INFO:teuthology.orchestra.run.trial158.stdout:yes 2026-02-12T22:23:15.601 DEBUG:teuthology.orchestra.run.trial158:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:23:15.669 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial158 2026-02-12T22:23:15.669 DEBUG:teuthology.orchestra.run.trial158:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:23:15.734 INFO:teuthology.orchestra.run.trial158.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:23:17.505 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:23:17.530 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:23:17.765 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:23:17.765 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-12T22:23:17.765 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-12T22:23:17.765 INFO:teuthology.orchestra.run.trial138.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:17.765 INFO:teuthology.orchestra.run.trial138.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:17.766 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:17.766 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:17.766 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:17.766 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-12T22:23:17.766 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-12T22:23:17.828 DEBUG:teuthology.orchestra.run.trial138:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:23:17.862 INFO:teuthology.orchestra.run.trial138.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:17.863 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:17.863 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:17.863 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:23:17.863 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:23:17.863 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2026-02-12T22:23:17.863 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial138.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:23:17.863 DEBUG:teuthology.orchestra.run.trial138:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:23:17.936 INFO:teuthology.orchestra.run.trial138.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:17.937 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:17.937 DEBUG:teuthology.orchestra.run.trial138:> sudo rpm -qi grub2-tools 2026-02-12T22:23:18.008 INFO:teuthology.orchestra.run.trial138.stdout:Name : grub2-tools 2026-02-12T22:23:18.009 INFO:teuthology.orchestra.run.trial138.stdout:Epoch : 1 2026-02-12T22:23:18.009 INFO:teuthology.orchestra.run.trial138.stdout:Version : 2.12 2026-02-12T22:23:18.009 INFO:teuthology.orchestra.run.trial138.stdout:Release : 29.el10_1 2026-02-12T22:23:18.009 INFO:teuthology.orchestra.run.trial138.stdout:Architecture: x86_64 2026-02-12T22:23:18.009 INFO:teuthology.orchestra.run.trial138.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:23:18.009 INFO:teuthology.orchestra.run.trial138.stdout:Group : Unspecified 2026-02-12T22:23:18.009 INFO:teuthology.orchestra.run.trial138.stdout:Size : 7963769 2026-02-12T22:23:18.009 INFO:teuthology.orchestra.run.trial138.stdout:License : GPL-3.0-or-later 2026-02-12T22:23:18.010 INFO:teuthology.orchestra.run.trial138.stdout:Signature : 2026-02-12T22:23:18.010 INFO:teuthology.orchestra.run.trial138.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:23:18.010 INFO:teuthology.orchestra.run.trial138.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:23:18.010 INFO:teuthology.orchestra.run.trial138.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:23:18.010 INFO:teuthology.orchestra.run.trial138.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:23:18.010 INFO:teuthology.orchestra.run.trial138.stdout:Packager : Release Engineering 2026-02-12T22:23:18.010 INFO:teuthology.orchestra.run.trial138.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:23:18.010 INFO:teuthology.orchestra.run.trial138.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:23:18.010 INFO:teuthology.orchestra.run.trial138.stdout:Summary : Support tools for GRUB. 2026-02-12T22:23:18.010 INFO:teuthology.orchestra.run.trial138.stdout:Description : 2026-02-12T22:23:18.010 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-12T22:23:18.011 INFO:teuthology.orchestra.run.trial138.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:23:18.011 INFO:teuthology.orchestra.run.trial138.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:23:18.011 INFO:teuthology.orchestra.run.trial138.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:23:18.011 INFO:teuthology.orchestra.run.trial138.stdout:hardware devices. 2026-02-12T22:23:18.011 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-12T22:23:18.011 INFO:teuthology.orchestra.run.trial138.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:23:18.012 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:23:18.012 INFO:teuthology.task.kernel:Updating grub on trial138 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:18.012 DEBUG:teuthology.orchestra.run.trial138:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:23:18.078 INFO:teuthology.orchestra.run.trial138.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:23:18.079 DEBUG:teuthology.orchestra.run.trial138:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:23:18.145 INFO:teuthology.orchestra.run.trial138.stdout:/sbin/grubby 2026-02-12T22:23:18.146 INFO:teuthology.orchestra.run.trial138.stdout:yes 2026-02-12T22:23:18.147 DEBUG:teuthology.orchestra.run.trial138:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:23:18.212 INFO:teuthology.orchestra.run.trial138.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:23:18.213 DEBUG:teuthology.orchestra.run.trial138:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:18.292 DEBUG:teuthology.orchestra.run.trial138:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:23:18.403 INFO:teuthology.orchestra.run.trial138.stderr:Generating grub configuration file ... 2026-02-12T22:23:18.578 INFO:teuthology.orchestra.run.trial138.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:23:18.587 INFO:teuthology.orchestra.run.trial138.stderr:done 2026-02-12T22:23:18.589 DEBUG:teuthology.orchestra.run.trial138:> test -d /sys/firmware/efi 2026-02-12T22:23:18.606 DEBUG:teuthology.orchestra.run.trial138:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:23:18.675 INFO:teuthology.orchestra.run.trial138.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:23:18.675 INFO:teuthology.orchestra.run.trial138.stdout:/boot/efi/EFI/rocky 2026-02-12T22:23:18.677 DEBUG:teuthology.orchestra.run.trial138:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:23:18.744 INFO:teuthology.orchestra.run.trial138.stdout:no 2026-02-12T22:23:18.744 DEBUG:teuthology.orchestra.run.trial138:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:23:18.811 INFO:teuthology.orchestra.run.trial138.stdout:yes 2026-02-12T22:23:18.811 DEBUG:teuthology.orchestra.run.trial138:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:23:18.878 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial138 2026-02-12T22:23:18.878 DEBUG:teuthology.orchestra.run.trial138:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:23:18.942 INFO:teuthology.orchestra.run.trial138.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:23:45.711 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:23:45.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:45.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:45.822 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:23:45.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:45.900 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:45.901 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:23:45.958 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:45.959 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:45.959 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:45.959 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:46.961 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:23:46.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:46.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:47.069 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:23:47.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:47.159 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:47.159 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:23:47.217 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:47.217 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:47.217 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:47.217 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:48.219 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:23:48.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:48.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:48.328 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:23:48.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:48.399 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:48.400 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:23:48.458 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:48.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:48.458 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:48.458 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:48.920 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:23:48.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:48.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:49.031 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:23:49.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:49.113 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:49.113 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:23:49.170 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:49.170 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:49.170 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:49.170 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:49.459 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:23:49.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:49.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:49.566 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:23:49.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:49.651 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:49.651 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:23:49.708 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:49.708 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:49.708 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:49.709 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:50.172 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:23:50.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:50.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:50.281 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:23:50.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:50.363 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:50.363 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:23:50.420 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:50.420 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:50.420 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:50.420 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:50.710 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:23:50.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:50.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:50.817 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:23:50.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:50.891 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:50.891 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:23:50.948 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:50.949 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:50.949 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:50.949 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:51.421 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:23:51.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:51.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:51.531 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:23:51.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:51.607 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:51.607 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:23:51.664 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:51.664 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:51.664 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:51.664 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:51.950 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:23:51.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:51.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:52.051 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:23:52.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:52.146 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:52.146 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:23:52.202 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:52.202 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:52.202 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:52.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:52.665 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:23:52.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:52.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:52.775 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:23:52.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:52.856 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:52.856 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:23:52.913 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:52.913 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:52.913 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:52.913 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:53.203 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:23:53.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:53.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:53.310 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:23:53.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:53.392 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:53.392 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:23:53.450 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:53.450 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:53.450 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:53.450 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:53.914 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:23:53.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:53.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:54.024 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:23:54.096 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:54.096 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:54.097 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:23:54.154 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:54.154 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:54.154 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:54.154 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:54.452 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:23:54.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:54.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:54.560 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:23:54.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:54.649 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:54.649 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:23:54.706 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:54.706 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:54.706 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:54.706 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:55.155 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:23:55.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:55.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:55.265 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:23:55.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:55.339 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:55.340 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:23:55.397 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:55.397 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:55.397 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:55.397 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:55.707 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:23:55.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:55.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:55.815 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:23:55.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:55.891 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:55.891 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:23:55.948 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:55.949 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:55.949 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:55.949 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:56.398 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:23:56.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:56.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:56.508 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:23:56.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:56.588 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:56.588 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:23:56.646 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:56.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:56.646 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:56.647 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:56.950 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:23:56.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:56.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:57.058 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:23:57.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:57.145 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:57.145 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:23:57.203 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:57.203 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:57.203 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:57.204 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:57.648 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:23:57.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:57.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:57.759 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:23:57.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:57.835 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:57.835 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:23:57.893 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:57.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:57.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:57.894 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:58.205 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:23:58.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:58.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:58.313 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:23:58.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:58.400 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:58.401 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:23:58.458 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:58.459 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:58.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:58.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:58.895 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:23:58.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:58.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:59.004 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:23:59.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:23:59.090 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:59.090 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:23:59.147 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:59.147 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:59.148 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:59.148 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:23:59.461 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:23:59.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:59.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:59.571 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:23:59.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:23:59.652 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:23:59.652 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:23:59.709 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:59.709 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:23:59.709 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:23:59.709 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:00.149 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:00.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:00.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:00.259 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:00.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:00.336 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:00.336 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:00.394 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:00.394 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:00.394 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:00.395 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:00.710 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:00.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:00.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:00.819 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:00.893 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:00.893 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:00.893 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:00.949 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:00.950 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:00.950 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:00.950 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:01.396 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:01.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:01.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:01.507 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:01.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:01.582 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:01.582 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:01.640 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:01.640 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:01.641 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:01.641 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:01.951 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:01.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:01.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:02.059 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:02.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:02.141 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:02.141 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:02.199 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:02.199 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:02.199 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:02.200 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:02.642 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:02.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:02.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:02.753 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:02.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:02.831 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:02.831 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:02.889 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:02.890 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:02.890 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:02.890 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:03.201 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:03.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:03.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:03.309 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:03.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:03.390 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:03.390 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:03.448 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:03.448 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:03.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:03.449 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:03.891 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:03.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:03.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:03.975 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:04.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:04.059 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:04.059 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:04.116 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:04.117 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:04.117 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:04.117 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:04.450 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:04.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:04.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:04.559 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:04.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:04.635 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:04.636 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:04.692 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:04.693 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:04.693 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:04.693 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:05.118 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:05.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:05.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:05.228 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:05.303 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:05.303 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:05.304 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:05.363 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:05.364 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:05.364 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:05.364 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:05.694 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:05.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:05.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:05.802 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:05.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:05.877 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:05.877 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:05.933 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:05.934 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:05.934 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:05.934 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:06.365 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:06.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:06.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:06.474 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:06.562 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:06.562 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:06.562 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:06.620 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:06.621 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:06.621 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:06.621 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:06.935 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:06.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:06.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:07.042 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:07.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:07.116 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:07.117 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:07.174 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:07.174 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:07.174 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:07.174 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:07.622 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:07.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:07.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:07.733 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:07.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:07.816 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:07.816 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:07.873 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:07.873 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:07.874 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:07.874 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:08.176 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:08.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:08.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:08.284 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:08.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:08.361 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:08.361 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:08.418 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:08.419 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:08.419 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:08.419 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:08.875 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:08.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:08.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:08.984 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:09.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:09.069 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:09.069 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:09.126 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:09.127 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:09.127 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:09.127 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:09.421 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:09.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:09.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:09.550 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:09.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:09.608 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:09.608 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:09.666 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:09.666 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:09.667 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:09.667 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:10.128 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:10.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:10.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:10.237 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:10.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:10.319 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:10.320 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:10.377 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:10.377 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:10.377 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:10.377 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:10.668 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:10.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:10.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:10.775 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:10.861 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:10.861 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:10.861 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:10.919 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:10.919 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:10.919 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:10.919 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:11.379 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:11.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:11.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:11.488 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:11.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:11.565 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:11.565 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:11.623 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:11.623 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:11.623 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:11.623 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:11.921 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:11.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:11.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:12.029 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:12.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:12.116 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:12.117 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:12.174 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:12.174 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:12.174 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:12.175 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:12.625 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:12.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:12.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:12.735 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:12.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:12.818 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:12.818 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:12.877 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:12.877 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:12.877 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:12.878 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:13.176 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:13.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:13.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:13.285 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:13.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:13.368 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:13.368 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:13.427 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:13.427 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:13.428 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:13.428 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:13.879 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:13.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:13.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:13.989 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:14.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:14.065 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:14.065 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:14.122 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:14.123 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:14.123 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:14.123 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:14.429 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:14.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:14.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:14.537 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:14.614 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:14.615 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:14.615 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:14.671 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:14.672 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:14.672 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:14.672 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:15.124 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:15.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:15.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:15.235 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:15.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:15.314 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:15.314 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:15.371 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:15.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:15.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:15.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:15.673 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:15.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:15.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:15.782 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:15.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:15.862 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:15.862 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:15.920 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:15.921 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:15.921 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:15.921 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:16.373 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:16.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:16.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:16.486 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:16.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:16.563 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:16.563 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:16.620 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:16.620 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:16.621 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:16.621 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:16.922 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:16.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:16.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:17.031 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:17.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:17.105 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:17.105 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:17.162 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:17.163 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:17.163 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:17.163 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:17.621 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:17.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:17.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:17.731 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:17.817 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:17.817 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:17.817 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:17.875 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:17.875 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:17.875 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:17.875 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:18.164 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:18.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:18.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:18.273 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:18.345 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:18.345 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:18.345 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:18.403 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:18.403 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:18.404 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:18.404 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:18.876 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:18.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:18.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:18.987 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:19.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:19.062 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:19.062 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:19.118 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:19.119 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:19.119 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:19.119 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:19.405 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:19.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:19.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:19.512 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:19.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:19.582 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:19.582 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:19.639 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:19.639 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:19.640 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:19.640 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:20.120 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:20.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:20.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:20.229 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:20.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:20.305 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:20.305 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:20.363 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:20.363 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:20.363 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:20.363 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:20.641 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:20.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:20.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:20.703 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:20.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:20.779 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:20.779 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:20.836 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:20.836 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:20.836 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:20.836 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:21.365 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:21.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:21.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:21.474 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:21.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:21.548 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:21.549 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:21.605 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:21.606 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:21.606 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:21.606 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:21.837 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:21.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:21.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:21.944 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:22.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:22.022 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:22.022 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:22.079 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:22.079 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:22.079 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:22.079 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:22.608 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:22.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:22.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:22.717 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:22.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:22.802 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:22.802 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:22.858 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:22.859 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:22.859 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:22.859 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:23.080 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:23.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:23.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:23.188 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:23.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:23.274 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:23.275 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:23.332 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:23.332 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:23.332 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:23.332 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:23.860 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:23.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:23.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:23.969 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:24.044 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:24.044 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:24.044 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:24.101 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:24.101 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:24.101 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:24.102 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:24.333 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:24.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:24.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:24.442 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:24.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:24.532 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:24.532 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:24.589 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:24.589 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:24.589 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:24.589 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:25.103 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:25.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:25.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:25.212 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:25.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:25.298 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:25.298 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:25.356 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:25.356 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:25.356 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:25.357 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:25.591 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:25.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:25.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:25.726 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:25.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:25.802 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:25.802 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:25.858 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:25.859 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:25.859 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:25.859 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:26.358 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:26.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:26.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:26.468 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:26.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:26.552 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:26.552 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:26.611 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:26.611 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:26.611 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:26.611 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:26.860 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:26.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:26.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:26.969 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:27.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:27.045 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:27.046 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:27.103 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:27.104 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:27.104 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:27.104 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:27.613 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:27.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:27.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:27.723 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:27.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:27.809 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:27.809 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:27.867 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:27.867 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:27.867 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:27.867 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:28.105 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:28.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:28.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:28.216 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:28.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:28.293 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:28.293 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:28.351 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:28.351 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:28.352 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:28.352 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:28.868 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:28.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:28.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:28.979 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:29.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:29.059 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:29.059 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:29.117 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:29.117 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:29.118 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:29.118 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:29.353 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:29.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:29.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:29.462 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:29.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:29.532 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:29.532 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:29.589 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:29.589 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:29.590 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:29.590 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:30.119 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:30.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:30.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:30.230 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:30.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:30.306 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:30.306 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:30.363 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:30.363 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:30.363 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:30.364 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:30.591 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:30.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:30.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:30.699 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:30.768 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:30.768 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:30.769 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:30.826 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:30.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:30.826 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:30.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:31.365 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:31.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:31.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:31.474 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:31.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:31.546 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:31.547 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:31.605 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:31.605 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:31.605 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:31.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:31.828 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:31.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:31.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:31.937 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:32.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:32.024 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:32.024 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:32.081 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:32.081 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:32.081 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:32.081 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:32.606 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:32.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:32.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:32.717 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:32.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:32.805 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:32.805 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:32.862 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:32.862 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:32.862 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:32.862 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:33.083 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:33.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:33.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:33.192 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:33.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:33.269 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:33.270 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:33.327 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:33.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:33.327 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:33.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:33.863 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:33.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:33.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:33.973 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:34.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:34.064 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:34.064 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:34.122 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:34.123 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:34.123 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:34.123 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:34.328 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:34.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:34.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:34.437 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:34.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:34.521 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:34.521 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:34.579 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:34.579 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:34.580 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:34.580 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:35.124 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:35.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:35.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:35.233 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:35.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:35.323 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:35.323 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:35.379 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:35.380 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:35.380 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:35.380 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:35.581 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:35.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:35.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:35.689 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:35.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:35.774 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:35.774 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:35.832 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:35.832 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:35.832 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:35.832 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:36.381 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:36.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:36.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:36.493 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:36.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:36.580 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:36.580 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:36.638 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:36.638 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:36.638 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:36.638 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:36.834 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:36.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:36.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:36.944 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:37.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:37.022 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:37.022 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:37.079 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:37.079 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:37.080 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:37.080 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:37.640 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:37.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:37.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:37.750 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:37.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:37.832 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:37.832 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:37.890 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:37.890 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:37.890 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:37.891 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:38.081 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:38.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:38.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:38.190 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:38.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:38.264 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:38.264 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:38.321 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:38.321 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:38.321 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:38.322 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:38.892 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:38.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:38.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:39.002 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:39.088 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:39.088 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:39.088 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:39.146 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:39.147 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:39.147 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:39.147 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:39.323 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:39.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:39.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:39.432 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:39.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:39.517 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:39.517 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:39.575 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:39.575 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:39.575 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:39.576 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:40.149 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:40.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:40.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:40.259 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:40.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:40.341 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:40.341 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:40.399 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:40.399 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:40.399 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:40.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:40.577 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:40.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:40.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:40.686 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:40.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:40.760 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:40.760 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:40.818 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:40.818 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:40.818 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:40.818 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:41.400 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:41.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:41.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:41.511 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:41.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:41.586 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:41.586 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:41.643 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:41.643 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.644 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:41.644 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:41.819 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:41.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:41.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:41.928 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:42.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:42.003 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:42.003 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:42.060 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:42.061 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:42.061 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:42.061 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:42.645 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:42.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:42.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:42.756 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:42.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:42.842 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:42.842 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:42.901 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:42.902 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:42.902 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:42.902 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:43.062 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:43.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:43.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:43.170 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:43.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:43.249 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:43.250 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:43.307 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:43.307 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:43.307 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:43.307 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:43.903 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:43.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:43.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:44.012 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:44.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:44.101 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:44.101 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:44.158 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:44.158 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:44.158 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:44.158 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:44.309 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:44.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:44.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:44.418 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:44.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:44.502 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:44.502 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:44.560 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:44.560 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:44.560 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:44.560 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:45.160 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:45.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:45.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:45.270 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:45.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:45.352 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:45.352 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:45.408 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:45.409 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:45.409 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:45.409 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:45.561 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:45.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:45.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:45.669 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:45.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:45.752 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:45.752 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:45.809 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:45.810 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:45.810 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:45.810 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:46.410 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:46.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:46.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:46.543 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:46.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:46.619 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:46.619 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:46.676 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:46.677 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:46.677 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:46.677 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:46.811 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:46.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:46.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:46.919 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:47.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:47.001 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:47.001 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:47.057 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:47.058 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:47.058 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:47.058 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:47.678 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:47.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:47.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:47.812 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:47.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:47.896 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:47.896 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:47.954 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:47.954 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:47.954 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:47.954 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:48.059 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:48.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:48.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:48.167 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:48.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:48.239 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:48.239 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:48.296 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:48.296 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:48.296 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:48.296 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:48.956 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:48.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:48.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:49.075 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:49.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:49.161 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:49.161 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:49.220 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:49.220 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:49.221 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:49.221 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:49.298 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:49.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:49.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:49.402 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:49.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:49.484 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:49.484 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:49.540 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:49.540 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:49.540 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:49.541 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:50.222 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:50.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:50.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:50.330 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:50.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:50.404 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:50.404 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:50.462 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:50.463 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:50.463 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:50.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:50.541 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:50.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:50.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:50.648 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:50.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:50.727 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:50.727 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:50.784 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:50.784 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:50.785 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:50.785 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:51.464 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:51.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:51.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:51.575 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:51.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:51.656 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:51.656 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:51.713 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:51.714 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:51.714 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:51.714 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:51.786 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:51.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:51.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:51.894 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:51.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:51.971 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:51.971 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:52.028 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:52.028 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:52.028 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:52.029 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:52.715 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:52.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:52.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:52.806 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:52.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:52.890 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:52.891 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:52.949 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:52.949 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:52.950 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:52.950 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:53.030 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:53.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:53.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:53.116 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:53.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:53.193 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:53.193 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:53.250 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:53.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:53.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:53.251 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:53.951 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:53.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:53.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:54.060 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:54.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:54.141 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:54.141 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:54.199 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:54.199 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:54.200 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:54.200 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:54.252 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:54.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:54.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:54.316 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:54.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:54.398 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:54.398 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:54.454 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:54.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:54.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:54.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:55.201 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:55.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:55.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:55.310 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:55.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:55.394 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:55.394 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:55.452 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:55.453 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:55.453 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:55.453 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:55.456 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:55.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:55.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:55.557 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:55.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:55.638 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:55.638 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:55.694 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:55.695 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:55.695 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:55.695 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:56.455 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:56.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:56.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:56.565 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:56.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:56.644 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:56.644 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:56.696 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:56.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:56.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:56.701 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:56.702 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:56.702 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:56.702 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:56.800 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:56.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:56.873 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:56.873 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:56.930 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:56.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:56.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:56.931 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:57.703 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:57.704 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:57.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:57.812 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:57.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:57.890 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:57.890 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:57.932 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:57.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:57.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:58.027 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:58.028 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:58.028 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:58.028 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:58.038 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:58.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:58.109 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:58.109 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:58.166 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:58.166 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:58.166 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:58.166 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:59.029 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:24:59.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:59.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:59.140 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:24:59.167 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:24:59.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:59.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:24:59.242 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:24:59.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:24:59.250 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:59.250 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:24:59.307 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:59.308 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:59.308 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:59.308 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:24:59.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:24:59.317 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:24:59.317 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:24:59.375 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:24:59.375 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:59.375 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:24:59.375 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:00.309 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:00.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:00.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:00.376 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:00.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:00.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:00.378 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:00.457 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:00.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:00.465 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:00.465 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:00.521 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:00.521 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:00.521 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:00.521 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:00.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:00.531 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:00.531 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:00.589 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:00.589 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:00.589 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:00.589 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:01.522 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:01.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:01.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:01.621 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:01.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:01.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:01.674 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:01.684 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:01.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:01.692 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:01.692 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:01.748 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:01.749 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:01.749 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:01.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:01.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:01.760 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:01.760 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:01.818 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:01.818 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:01.819 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:01.819 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:02.750 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:02.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:02.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:02.847 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:02.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:02.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:02.900 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:02.909 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:02.957 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:02.957 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:02.957 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:02.996 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:02.996 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:02.996 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:03.014 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:03.014 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:03.014 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:03.014 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:03.053 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:03.053 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:03.053 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:03.053 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:04.015 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:04.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:04.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:04.115 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:04.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:04.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:04.167 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:04.177 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:04.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:04.185 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:04.185 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:04.242 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:04.242 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:04.242 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:04.242 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:04.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:04.259 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:04.259 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:04.315 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:04.316 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:04.316 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:04.316 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:05.244 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:05.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:05.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:05.327 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:05.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:05.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:05.379 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:05.389 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:05.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:05.438 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:05.438 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:05.467 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:05.467 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:05.467 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:05.495 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:05.495 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:05.495 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:05.495 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:05.524 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:05.524 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:05.524 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:05.524 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:06.496 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:06.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:06.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:06.595 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:06.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:06.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:06.647 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:06.657 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:06.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:06.665 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:06.665 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:06.724 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:06.724 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:06.724 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:06.724 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:06.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:06.735 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:06.735 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:06.792 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:06.792 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:06.792 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:06.792 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:07.725 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:07.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:07.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:07.824 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:07.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:07.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:07.876 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:07.886 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:07.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:07.935 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:07.935 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:07.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:07.960 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:07.960 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:07.993 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:07.993 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:07.993 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:07.993 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:08.018 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:08.018 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:08.018 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:08.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:08.995 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:08.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:08.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:09.094 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:09.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:09.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:09.146 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:09.156 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:09.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:09.202 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:09.202 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:09.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:09.240 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:09.240 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:09.259 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:09.260 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:09.260 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:09.260 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:09.297 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:09.298 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:09.298 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:09.298 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:10.261 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:10.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:10.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:10.359 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:10.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:10.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:10.411 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:10.421 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:10.429 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:10.429 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:10.429 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:10.486 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:10.486 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:10.486 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:10.486 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:10.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:10.512 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:10.512 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:10.569 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:10.569 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:10.569 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:10.570 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:11.487 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:11.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:11.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:11.586 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:11.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:11.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:11.638 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:11.648 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:11.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:11.697 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:11.697 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:11.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:11.726 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:11.726 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:11.753 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:11.753 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:11.753 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:11.753 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:11.784 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:11.784 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:11.784 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:11.784 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:12.754 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:12.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:12.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:12.853 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:12.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:12.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:12.905 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:12.915 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:12.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:12.963 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:12.963 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:12.988 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:12.988 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:12.989 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:13.020 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:13.021 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:13.021 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:13.021 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:13.045 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:13.045 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:13.046 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:13.046 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:14.022 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:14.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:14.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:14.121 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:14.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:14.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:14.173 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:14.182 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:14.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:14.229 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:14.230 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:14.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:14.268 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:14.268 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:14.287 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:14.287 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:14.287 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:14.287 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:14.326 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:14.326 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:14.326 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:14.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:15.289 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:15.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:15.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:15.387 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:15.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:15.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:15.439 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:15.449 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:15.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:15.495 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:15.495 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:15.533 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:15.533 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:15.533 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:15.552 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:15.552 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:15.552 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:15.553 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:15.590 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:15.591 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:15.591 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:15.591 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:16.554 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:16.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:16.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:16.652 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:16.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:16.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:16.704 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:16.714 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:16.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:16.763 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:16.763 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:16.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:16.801 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:16.801 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:16.820 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:16.820 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:16.820 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:16.820 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:16.859 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:16.859 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:16.859 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:16.859 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:17.822 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:17.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:17.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:17.920 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:17.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:17.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:17.972 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:17.981 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:18.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:18.030 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:18.030 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:18.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:18.060 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:18.060 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:18.086 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:18.087 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:18.087 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:18.087 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:18.116 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:18.116 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:18.116 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:18.116 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:19.087 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:19.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:19.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:19.185 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:19.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:19.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:19.238 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:19.247 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:19.296 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:19.296 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:19.297 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:19.320 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:19.320 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:19.320 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:19.353 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:19.354 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:19.354 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:19.354 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:19.379 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:19.379 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:19.379 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:19.379 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:20.355 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:20.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:20.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:20.453 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:20.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:20.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:20.528 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:20.539 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:20.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:20.549 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:20.549 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:20.606 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:20.607 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:20.607 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:20.607 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:20.614 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:20.614 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:20.614 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:20.671 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:20.672 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:20.672 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:20.672 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:21.608 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:21.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:21.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:21.695 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:21.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:21.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:21.747 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:21.757 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:21.807 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:21.807 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:21.807 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:21.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:21.832 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:21.832 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:21.864 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:21.864 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:21.864 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:21.865 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:21.890 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:21.890 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:21.890 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:21.891 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:22.866 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:22.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:22.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:22.959 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:22.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:22.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:23.011 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:23.021 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:23.070 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:23.070 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:23.070 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:23.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:23.101 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:23.101 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:23.128 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:23.128 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:23.128 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:23.128 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:23.157 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:23.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:23.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:23.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:24.129 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:24.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:24.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:24.228 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:24.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:24.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:24.281 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:24.291 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:24.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:24.341 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:24.341 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:24.367 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:24.367 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:24.367 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:24.398 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:24.398 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:24.399 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:24.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:24.425 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:24.425 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:24.425 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:24.425 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:25.399 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:25.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:25.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:25.498 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:25.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:25.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:25.550 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:25.560 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:25.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:25.608 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:25.608 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:25.639 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:25.639 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:25.639 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:25.665 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:25.666 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:25.666 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:25.666 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:25.695 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:25.695 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:25.695 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:25.695 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:26.666 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:26.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:26.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:26.764 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:26.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:26.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:26.817 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:26.827 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:26.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:26.834 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:26.834 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:26.892 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:26.892 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:26.892 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:26.892 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:26.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:26.917 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:26.917 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:26.974 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:26.974 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:26.975 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:26.975 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:27.893 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:27.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:27.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:27.991 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:27.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:27.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:28.044 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:28.054 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:28.061 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:28.061 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:28.061 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:28.119 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:28.119 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:28.119 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:28.119 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:28.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:28.136 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:28.136 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:28.192 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:28.193 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:28.193 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:28.193 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:29.120 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:29.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:29.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:29.218 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:29.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:29.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:29.271 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:29.280 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:29.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:29.330 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:29.330 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:29.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:29.356 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:29.356 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:29.386 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:29.386 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:29.386 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:29.386 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:29.413 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:29.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:29.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:29.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:30.387 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:30.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:30.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:30.444 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:30.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:30.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:30.496 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:30.505 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:30.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:30.554 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:30.555 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:30.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:30.592 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:30.592 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:30.612 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:30.612 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:30.612 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:30.612 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:30.649 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:30.649 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:30.649 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:30.649 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:31.613 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:31.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:31.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:31.724 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:31.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:31.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:31.789 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:31.798 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:31.807 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:31.807 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:31.807 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:31.863 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:31.864 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:31.864 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:31.864 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:31.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:31.888 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:31.888 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:31.944 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:31.945 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:31.945 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:31.945 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:32.865 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:32.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:32.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:32.964 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:32.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:32.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:33.016 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:33.025 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:33.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:33.073 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:33.073 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:33.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:33.106 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:33.106 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:33.130 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:33.130 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:33.130 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:33.130 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:33.163 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:33.164 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:33.164 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:33.164 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:34.132 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:34.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:34.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:34.231 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:34.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:34.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:34.283 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:34.293 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:34.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:34.341 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:34.341 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:34.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:34.370 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:34.370 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:34.398 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:34.398 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:34.398 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:34.398 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:34.427 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:34.427 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:34.427 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:34.427 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:35.399 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:35.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:35.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:35.498 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:35.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:35.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:35.549 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:35.559 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:35.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:35.607 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:35.607 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:35.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:35.637 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:35.637 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:35.663 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:35.664 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:35.664 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:35.664 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:35.694 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:35.694 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:35.694 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:35.694 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:36.665 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:36.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:36.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:36.763 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:36.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:36.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:36.816 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:36.825 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:36.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:36.874 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:36.874 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:36.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:36.917 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:36.917 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:36.932 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:36.932 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:36.932 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:36.932 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:36.974 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:36.975 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:36.975 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:36.975 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:37.933 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:37.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:37.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:38.033 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:38.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:38.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:38.085 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:38.095 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:38.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:38.143 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:38.143 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:38.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:38.168 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:38.169 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:38.201 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:38.201 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:38.201 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:38.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:38.226 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:38.226 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:38.226 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:38.226 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:39.202 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:39.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:39.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:39.300 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:39.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:39.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:39.353 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:39.362 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:39.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:39.411 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:39.411 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:39.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:39.445 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:39.445 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:39.467 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:39.467 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:39.467 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:39.467 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:39.503 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:39.503 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:39.503 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:39.503 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:40.469 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:40.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:40.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:40.567 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:40.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:40.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:40.620 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:40.630 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:40.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:40.678 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:40.678 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:40.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:40.714 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:40.714 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:40.735 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:40.736 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:40.736 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:40.736 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:40.772 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:40.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:40.772 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:40.773 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:41.737 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:41.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:41.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:41.838 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:41.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:41.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:41.890 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:41.900 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:41.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:41.908 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:41.908 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:41.965 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:41.965 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:41.965 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:41.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:41.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:41.977 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:41.977 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:42.034 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:42.035 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:42.035 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:42.035 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:42.966 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:42.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:42.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:43.064 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:43.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:43.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:43.117 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:43.126 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:43.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:43.175 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:43.175 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:43.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:43.201 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:43.201 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:43.232 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:43.232 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:43.232 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:43.232 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:43.258 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:43.258 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:43.258 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:43.258 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:44.233 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:44.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:44.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:44.330 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:44.330 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:44.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:44.382 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:44.391 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:44.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:44.440 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:44.440 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:44.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:44.476 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:44.476 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:44.497 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:44.498 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:44.498 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:44.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:44.533 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:44.533 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:44.533 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:44.533 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:45.498 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:45.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:45.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:45.597 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:45.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:45.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:45.649 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:45.658 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:45.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:45.666 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:45.666 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:45.723 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:45.723 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:45.723 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:45.723 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:45.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:45.735 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:45.735 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:45.793 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:45.793 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:45.793 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:45.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:46.724 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:46.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:46.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:46.824 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:46.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:46.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:46.876 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:46.885 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:46.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:46.935 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:46.935 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:46.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:46.962 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:46.962 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:46.992 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:46.992 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:46.992 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:46.992 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:47.019 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:47.019 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:47.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:47.019 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:47.993 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:47.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:47.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:48.091 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:48.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:48.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:48.143 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:48.153 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:48.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:48.202 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:48.202 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:48.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:48.236 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:48.236 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:48.259 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:48.259 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:48.259 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:48.259 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:48.293 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:48.293 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:48.293 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:48.293 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:49.260 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:49.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:49.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:49.358 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:49.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:49.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:49.411 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:49.421 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:49.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:49.470 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:49.470 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:49.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:49.506 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:49.506 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:49.526 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:49.527 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:49.527 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:49.527 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:49.564 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:49.564 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:49.564 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:49.564 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:50.527 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:50.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:50.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:50.626 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:50.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:50.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:50.679 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:50.690 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:50.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:50.698 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:50.699 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:50.755 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:50.757 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:50.757 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:50.757 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:50.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:50.775 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:50.775 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:50.832 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:50.833 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:50.833 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:50.833 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:51.758 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:51.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:51.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:51.856 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:51.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:51.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:51.909 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:51.918 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:51.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:51.926 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:51.926 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:51.985 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:51.985 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:51.985 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:51.985 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:51.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:51.993 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:51.994 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:52.050 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:52.051 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:52.051 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:52.051 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:52.986 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:52.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:52.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:53.112 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:53.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:53.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:53.165 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:53.175 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:53.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:53.182 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:53.183 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:53.239 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:53.240 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:53.240 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:53.240 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:53.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:53.261 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:53.262 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:53.319 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:53.319 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:53.319 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:53.319 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:54.241 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:54.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:54.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:54.337 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:54.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:54.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:54.389 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:54.399 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:54.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:54.407 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:54.407 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:54.464 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:54.464 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:54.464 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:54.464 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:54.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:54.490 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:54.490 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:54.546 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:54.547 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:54.547 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:54.547 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:55.465 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:55.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:55.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:55.564 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:55.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:55.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:55.616 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:55.626 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:55.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:55.674 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:55.675 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:55.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:55.712 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:55.712 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:55.731 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:55.731 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:55.731 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:55.732 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:55.770 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:55.770 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:55.770 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:55.770 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:56.733 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:56.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:56.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:56.834 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:56.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:56.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:56.886 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:56.896 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:56.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:56.904 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:56.904 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:56.962 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:56.962 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:56.962 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:56.962 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:56.981 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:56.981 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:56.981 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:57.039 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:57.039 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:57.039 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:57.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:57.962 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:57.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:57.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:58.061 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:58.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:58.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:58.113 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:58.123 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:58.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:58.172 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:58.172 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:58.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:58.206 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:58.206 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:58.229 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:58.229 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:58.229 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:58.229 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:58.263 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:58.264 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:58.264 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:58.264 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:59.230 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:25:59.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:59.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:59.329 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:25:59.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:59.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:59.381 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:25:59.391 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:25:59.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:25:59.440 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:59.440 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:25:59.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:25:59.471 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:59.471 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:25:59.497 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:59.497 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:59.497 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:59.497 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:59.528 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:59.529 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:59.529 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:59.529 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:00.497 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:00.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:00.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:00.596 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:00.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:00.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:00.648 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:00.658 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:00.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:00.666 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:00.666 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:00.724 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:00.724 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:00.724 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:00.724 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:00.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:00.736 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:00.736 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:00.793 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:00.793 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:00.793 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:00.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:01.724 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:01.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:01.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:01.823 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:01.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:01.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:01.876 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:01.886 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:01.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:01.894 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:01.894 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:01.950 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:01.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:01.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:01.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:01.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:01.970 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:01.970 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:02.026 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:02.027 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:02.027 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:02.027 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:02.951 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:02.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:02.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:03.051 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:03.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:03.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:03.103 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:03.113 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:03.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:03.121 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:03.121 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:03.178 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:03.179 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:03.179 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:03.179 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:03.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:03.191 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:03.191 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:03.250 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:03.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:03.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:03.251 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:04.180 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:04.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:04.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:04.263 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:04.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:04.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:04.314 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:04.324 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:04.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:04.374 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:04.374 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:04.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:04.406 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:04.406 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:04.431 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:04.431 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:04.431 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:04.431 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:04.464 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:04.464 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:04.464 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:04.464 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:05.432 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:05.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:05.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:05.530 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:05.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:05.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:05.582 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:05.592 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:05.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:05.599 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:05.600 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:05.657 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:05.658 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:05.658 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:05.658 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:05.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:05.683 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:05.683 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:05.740 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:05.740 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:05.740 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:05.740 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:06.658 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:06.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:06.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:06.758 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:06.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:06.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:06.811 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:06.820 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:06.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:06.869 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:06.869 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:06.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:06.898 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:06.898 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:06.926 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:06.926 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:06.926 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:06.926 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:06.955 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:06.955 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:06.955 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:06.955 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:07.927 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:07.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:07.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:08.026 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:08.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:08.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:08.098 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:08.108 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:08.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:08.117 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:08.117 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:08.173 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:08.173 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:08.174 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:08.174 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:08.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:08.190 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:08.190 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:08.246 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:08.247 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:08.247 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:08.247 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:09.174 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:09.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:09.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:09.273 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:09.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:09.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:09.324 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:09.334 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:09.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:09.384 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:09.384 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:09.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:09.410 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:09.411 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:09.441 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:09.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:09.441 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:09.441 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:09.468 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:09.468 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:09.468 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:09.468 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:10.442 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:10.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:10.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:10.500 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:10.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:10.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:10.552 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:10.562 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:10.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:10.611 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:10.611 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:10.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:10.642 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:10.642 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:10.667 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:10.667 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:10.667 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:10.667 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:10.700 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:10.700 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:10.700 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:10.700 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:11.669 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:11.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:11.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:11.730 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:11.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:11.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:11.782 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:11.792 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:11.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:11.842 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:11.842 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:11.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:11.876 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:11.876 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:11.899 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:11.899 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:11.899 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:11.900 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:11.934 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:11.934 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:11.934 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:11.934 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:12.900 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:12.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:12.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:12.952 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:12.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:12.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:13.004 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:13.014 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:13.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:13.063 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:13.063 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:13.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:13.102 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:13.102 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:13.119 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:13.120 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:13.120 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:13.120 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:13.160 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:13.160 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:13.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:13.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:14.121 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:14.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:14.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:14.181 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:14.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:14.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:14.232 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:14.242 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:14.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:14.291 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:14.291 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:14.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:14.321 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:14.321 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:14.350 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:14.350 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:14.350 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:14.350 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:14.378 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:14.378 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:14.378 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:14.378 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:15.351 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:15.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:15.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:15.403 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:15.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:15.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:15.456 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:15.465 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:15.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:15.514 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:15.514 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:15.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:15.538 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:15.538 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:15.571 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:15.571 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:15.571 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:15.571 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:15.595 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:15.595 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:15.596 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:15.596 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:16.572 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:16.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:16.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:16.671 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:16.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:16.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:16.723 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:16.733 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:16.781 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:16.781 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:16.781 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:16.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:16.806 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:16.806 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:16.838 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:16.838 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:16.838 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:16.838 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:16.863 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:16.864 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:16.864 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:16.864 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:17.839 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:17.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:17.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:17.938 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:17.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:17.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:17.990 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:17.999 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:18.048 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:18.049 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:18.049 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:18.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:18.074 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:18.074 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:18.106 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:18.106 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:18.106 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:18.106 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:18.131 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:18.131 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:18.131 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:18.131 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:19.107 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:19.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:19.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:19.206 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:19.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:19.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:19.259 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:19.269 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:19.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:19.277 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:19.277 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:19.334 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:19.334 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:19.334 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:19.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:19.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:19.348 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:19.348 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:19.406 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:19.406 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:19.407 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:19.407 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:20.335 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:20.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:20.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:20.433 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:20.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:20.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:20.485 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:20.494 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:20.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:20.543 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:20.543 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:20.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:20.565 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:20.565 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:20.600 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:20.601 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:20.601 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:20.601 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:20.621 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:20.621 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:20.621 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:20.621 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:21.602 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:21.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:21.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:21.701 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:21.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:21.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:21.753 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:21.763 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:21.811 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:21.812 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:21.812 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:21.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:21.852 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:21.852 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:21.869 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:21.869 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:21.869 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:21.869 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:21.910 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:21.911 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:21.911 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:21.911 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:22.870 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:22.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:22.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:22.969 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:22.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:22.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:23.021 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:23.031 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:23.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:23.080 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:23.080 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:23.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:23.102 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:23.103 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:23.138 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:23.139 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:23.139 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:23.139 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:23.160 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:23.160 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:23.160 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:23.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:24.140 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:24.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:24.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:24.239 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:24.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:24.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:24.291 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:24.300 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:24.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:24.348 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:24.348 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:24.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:24.383 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:24.383 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:24.405 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:24.405 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:24.405 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:24.405 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:24.441 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:24.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:24.441 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:24.442 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:25.406 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:25.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:25.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:25.469 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:25.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:25.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:25.520 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:25.530 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:25.579 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:25.579 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:25.579 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:25.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:25.605 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:25.605 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:25.635 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:25.635 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:25.635 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:25.635 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:25.662 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:25.662 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:25.662 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:25.662 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:26.636 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:26.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:26.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:26.735 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:26.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:26.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:26.786 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:26.796 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:26.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:26.845 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:26.845 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:26.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:26.877 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:26.877 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:26.902 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:26.902 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:26.902 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:26.902 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:26.935 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:26.935 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:26.935 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:26.935 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:27.903 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:27.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:27.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:28.002 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:28.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:28.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:28.054 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:28.064 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:28.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:28.113 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:28.113 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:28.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:28.142 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:28.142 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:28.169 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:28.170 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:28.170 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:28.170 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:28.198 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:28.199 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:28.199 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:28.199 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:29.171 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:29.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:29.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:29.270 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:29.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:29.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:29.322 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:29.331 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:29.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:29.381 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:29.381 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:29.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:29.407 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:29.407 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:29.437 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:29.438 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:29.438 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:29.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:29.464 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:29.464 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:29.464 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:29.464 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:30.439 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:30.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:30.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:30.510 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:30.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:30.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:30.561 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:30.570 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:30.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:30.620 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:30.620 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:30.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:30.647 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:30.647 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:30.677 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:30.677 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:30.677 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:30.677 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:30.704 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:30.705 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:30.705 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:30.705 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:31.678 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:31.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:31.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:31.775 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:31.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:31.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:31.827 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:31.837 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:31.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:31.886 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:31.887 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:31.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:31.911 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:31.911 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:31.944 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:31.945 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:31.945 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:31.945 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:31.968 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:31.968 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:31.968 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:31.968 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:32.947 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:32.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:32.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:33.045 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:33.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:33.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:33.096 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:33.106 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:33.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:33.156 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:33.156 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:33.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:33.178 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:33.178 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:33.213 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:33.214 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:33.214 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:33.214 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:33.235 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:33.236 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:33.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:33.236 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:34.215 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:34.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:34.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:34.317 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:34.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:34.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:34.369 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:34.379 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:34.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:34.387 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:34.387 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:34.444 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:34.444 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:34.444 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:34.445 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:34.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:34.450 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:34.451 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:34.507 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:34.508 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:34.508 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:34.508 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:35.445 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:35.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:35.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:35.546 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:35.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:35.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:35.598 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:35.608 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:35.655 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:35.655 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:35.655 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:35.687 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:35.687 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:35.687 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:35.713 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:35.713 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:35.713 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:35.713 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:35.746 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:35.746 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:35.746 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:35.746 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:36.715 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:36.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:36.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:36.814 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:36.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:36.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:36.867 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:36.876 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:36.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:36.884 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:36.884 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:36.941 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:36.942 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:36.942 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:36.942 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:36.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:36.960 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:36.961 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:37.018 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:37.019 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:37.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:37.019 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:37.942 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:37.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:37.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:38.004 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:38.020 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:38.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:38.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:38.080 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:38.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:38.086 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:38.086 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:38.143 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:38.143 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:38.143 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:38.143 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:38.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:38.156 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:38.156 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:38.212 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:38.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:38.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:38.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:39.144 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:39.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:39.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:39.242 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:39.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:39.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:39.295 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:39.304 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:39.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:39.354 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:39.354 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:39.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:39.390 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:39.390 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:39.411 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:39.411 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:39.411 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:39.411 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:39.448 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:39.448 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:39.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:39.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:40.412 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:40.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:40.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:40.509 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:40.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:40.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:40.560 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:40.570 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:40.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:40.620 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:40.620 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:40.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:40.650 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:40.650 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:40.677 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:40.677 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:40.678 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:40.678 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:40.708 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:40.708 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:40.709 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:40.709 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:41.679 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:41.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:41.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:41.754 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:41.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:41.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:41.806 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:41.816 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:41.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:41.865 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:41.865 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:41.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:41.888 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:41.888 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:41.922 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:41.922 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:41.922 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:41.922 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:41.945 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:41.945 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:41.945 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:41.945 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:42.923 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:42.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:42.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:43.022 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:43.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:43.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:43.075 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:43.084 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:43.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:43.092 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:43.092 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:43.149 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:43.149 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:43.149 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:43.149 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:43.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:43.165 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:43.165 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:43.222 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:43.222 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:43.223 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:43.223 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:44.150 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:44.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:44.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:44.249 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:44.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:44.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:44.301 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:44.310 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:44.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:44.359 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:44.359 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:44.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:44.380 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:44.380 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:44.416 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:44.417 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:44.417 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:44.417 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:44.438 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:44.438 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:44.438 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:44.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:45.418 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:45.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:45.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:45.516 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:45.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:45.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:45.568 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:45.578 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:45.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:45.627 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:45.627 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:45.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:45.671 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:45.671 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:45.684 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:45.684 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:45.684 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:45.684 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:45.727 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:45.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:45.728 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:45.728 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:46.685 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:46.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:46.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:46.784 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:46.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:46.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:46.836 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:46.846 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:46.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:46.854 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:46.854 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:46.911 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:46.911 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:46.911 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:46.911 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:46.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:46.928 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:46.928 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:46.986 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:46.986 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:46.987 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:46.987 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:47.913 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:47.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:47.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:48.013 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:48.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:48.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:48.065 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:48.075 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:48.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:48.124 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:48.125 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:48.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:48.156 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:48.156 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:48.181 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:48.181 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:48.182 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:48.182 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:48.213 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:48.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:48.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:48.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:49.183 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:49.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:49.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:49.294 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:49.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:49.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:49.346 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:49.355 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:49.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:49.405 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:49.405 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:49.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:49.430 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:49.430 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:49.462 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:49.462 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:49.463 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:49.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:49.487 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:49.487 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:49.488 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:49.488 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:50.464 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:50.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:50.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:50.562 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:50.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:50.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:50.614 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:50.623 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:50.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:50.672 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:50.673 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:50.703 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:50.703 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:50.703 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:50.729 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:50.729 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:50.729 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:50.729 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:50.760 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:50.760 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:50.760 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:50.760 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:51.730 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:51.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:51.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:51.831 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:51.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:51.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:51.883 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:51.893 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:51.942 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:51.942 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:51.942 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:51.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:51.968 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:51.968 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:51.999 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:51.999 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:51.999 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:51.999 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:52.025 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:52.025 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:52.026 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:52.026 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:53.000 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:53.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:53.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:53.099 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:53.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:53.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:53.164 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:53.173 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:53.183 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:53.183 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:53.183 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:53.240 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:53.240 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:53.240 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:53.240 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:53.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:53.263 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:53.263 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:53.321 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:53.322 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:53.322 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:53.322 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:54.242 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:54.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:54.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:54.342 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:54.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:54.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:54.394 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:54.404 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:54.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:54.451 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:54.451 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:54.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:54.487 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:54.487 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:54.509 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:54.509 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:54.509 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:54.509 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:54.544 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:54.545 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:54.545 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:54.545 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:55.510 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:55.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:55.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:55.609 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:55.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:55.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:55.661 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:55.671 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:55.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:55.720 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:55.720 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:55.757 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:55.757 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:55.757 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:55.777 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:55.777 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:55.777 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:55.777 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:55.815 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:55.815 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:55.815 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:55.815 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:56.778 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:56.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:56.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:56.877 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:56.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:56.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:56.930 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:56.939 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:56.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:56.989 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:56.989 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:57.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:57.027 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:57.027 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:57.046 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:57.046 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:57.046 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:57.046 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:57.084 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:57.084 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:57.084 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:57.085 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:58.047 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:58.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:58.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:58.147 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:58.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:58.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:58.199 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:58.209 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:58.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:58.258 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:58.258 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:58.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:58.300 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:58.300 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:58.315 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:58.315 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:58.315 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:58.315 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:58.358 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:58.358 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:58.358 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:58.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:59.317 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:26:59.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:59.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:59.415 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:26:59.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:59.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:59.467 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:26:59.477 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:26:59.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:26:59.525 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:59.525 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:26:59.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:26:59.551 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:59.551 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:26:59.582 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:59.583 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:59.583 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:59.583 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:59.608 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:59.608 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:59.608 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:59.608 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:00.584 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:00.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:00.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:00.685 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:00.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:00.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:00.736 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:00.746 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:00.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:00.795 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:00.796 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:00.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:00.825 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:00.825 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:00.852 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:00.852 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:00.852 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:00.852 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:00.882 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:00.882 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:00.882 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:00.882 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:01.853 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:01.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:01.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:01.951 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:01.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:01.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:02.003 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:02.013 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:02.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:02.021 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:02.021 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:02.079 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:02.079 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:02.079 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:02.079 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:02.096 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:02.096 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:02.096 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:02.153 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:02.154 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:02.154 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:02.154 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:03.081 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:03.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:03.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:03.181 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:03.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:03.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:03.233 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:03.243 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:03.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:03.289 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:03.289 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:03.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:03.330 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:03.330 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:03.347 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:03.347 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:03.347 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:03.348 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:03.387 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:03.388 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:03.388 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:03.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:04.349 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:04.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:04.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:04.448 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:04.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:04.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:04.500 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:04.510 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:04.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:04.560 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:04.560 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:04.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:04.587 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:04.587 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:04.618 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:04.618 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:04.618 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:04.618 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:04.645 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:04.645 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:04.645 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:04.645 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:05.619 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:05.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:05.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:05.681 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:05.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:05.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:05.734 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:05.743 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:05.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:05.751 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:05.751 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:05.807 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:05.807 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:05.807 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:05.807 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:05.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:05.824 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:05.824 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:05.881 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:05.882 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:05.882 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:05.882 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:06.809 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:06.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:06.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:06.902 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:06.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:06.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:06.954 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:06.963 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:07.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:07.013 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:07.013 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:07.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:07.040 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:07.040 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:07.069 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:07.070 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:07.070 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:07.070 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:07.097 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:07.097 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:07.097 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:07.097 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:08.070 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:08.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:08.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:08.168 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:08.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:08.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:08.219 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:08.229 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:08.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:08.279 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:08.279 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:08.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:08.315 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:08.315 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:08.335 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:08.336 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:08.336 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:08.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:08.372 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:08.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:08.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:08.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:09.337 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:09.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:09.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:09.433 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:09.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:09.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:09.484 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:09.493 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:09.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:09.543 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:09.543 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:09.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:09.578 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:09.578 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:09.599 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:09.599 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:09.600 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:09.600 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:09.636 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:09.636 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:09.636 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:09.636 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:10.601 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:10.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:10.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:10.690 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:10.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:10.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:10.741 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:10.750 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:10.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:10.800 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:10.800 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:10.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:10.826 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:10.826 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:10.857 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:10.858 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:10.858 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:10.858 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:10.883 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:10.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:10.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:10.884 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:11.859 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:11.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:11.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:11.949 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:11.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:11.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:12.000 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:12.010 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:12.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:12.059 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:12.059 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:12.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:12.097 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:12.097 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:12.116 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:12.116 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:12.116 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:12.117 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:12.154 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:12.155 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:12.155 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:12.155 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:13.118 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:13.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:13.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:13.217 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:13.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:13.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:13.269 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:13.279 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:13.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:13.327 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:13.327 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:13.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:13.354 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:13.354 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:13.384 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:13.384 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:13.384 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:13.384 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:13.410 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:13.411 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:13.411 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:13.411 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:14.385 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:14.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:14.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:14.484 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:14.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:14.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:14.537 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:14.546 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:14.596 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:14.597 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:14.597 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:14.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:14.623 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:14.623 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:14.653 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:14.653 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:14.653 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:14.653 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:14.680 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:14.680 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:14.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:14.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:15.654 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:15.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:15.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:15.753 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:15.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:15.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:15.805 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:15.815 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:15.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:15.865 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:15.865 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:15.887 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:15.888 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:15.888 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:15.922 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:15.922 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:15.922 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:15.922 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:15.945 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:15.945 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:15.945 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:15.945 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:16.923 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:16.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:16.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:17.022 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:17.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:17.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:17.075 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:17.085 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:17.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:17.093 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:17.093 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:17.150 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:17.150 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:17.150 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:17.150 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:17.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:17.156 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:17.157 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:17.213 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:17.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:17.214 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:17.214 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:18.151 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:18.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:18.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:18.251 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:18.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:18.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:18.304 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:18.313 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:18.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:18.322 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:18.322 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:18.379 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:18.379 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:18.379 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:18.379 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:18.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:18.386 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:18.386 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:18.443 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:18.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:18.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:18.444 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:19.380 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:19.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:19.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:19.478 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:19.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:19.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:19.531 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:19.541 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:19.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:19.548 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:19.548 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:19.604 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:19.604 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:19.604 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:19.604 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:19.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:19.623 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:19.623 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:19.681 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:19.681 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:19.681 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:19.681 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:20.606 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:20.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:20.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:20.706 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:20.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:20.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:20.758 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:20.768 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:20.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:20.816 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:20.816 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:20.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:20.840 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:20.840 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:20.873 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:20.874 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:20.874 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:20.874 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:20.897 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:20.897 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:20.898 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:20.898 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:21.875 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:21.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:21.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:21.975 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:21.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:21.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:22.028 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:22.037 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:22.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:22.086 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:22.087 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:22.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:22.114 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:22.114 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:22.144 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:22.144 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:22.144 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:22.144 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:22.172 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:22.172 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:22.172 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:22.172 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:23.145 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:23.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:23.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:23.244 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:23.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:23.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:23.297 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:23.307 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:23.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:23.314 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:23.314 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:23.371 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:23.371 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:23.371 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:23.371 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:23.388 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:23.388 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:23.388 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:23.445 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:23.446 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:23.446 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:23.446 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:24.372 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:24.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:24.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:24.470 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:24.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:24.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:24.522 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:24.531 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:24.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:24.581 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:24.581 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:24.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:24.616 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:24.616 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:24.637 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:24.637 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:24.637 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:24.637 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:24.674 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:24.675 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:24.675 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:24.675 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:25.638 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:25.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:25.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:25.704 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:25.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:25.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:25.756 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:25.766 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:25.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:25.774 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:25.774 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:25.831 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:25.831 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:25.831 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:25.831 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:25.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:25.850 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:25.850 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:25.907 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:25.907 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:25.907 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:25.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:26.832 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:26.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:26.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:26.931 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:26.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:26.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:26.983 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:26.992 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:27.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:27.041 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:27.041 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:27.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:27.066 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:27.066 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:27.098 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:27.098 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:27.098 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:27.098 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:27.123 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:27.123 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:27.123 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:27.123 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:28.099 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:28.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:28.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:28.197 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:28.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:28.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:28.249 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:28.259 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:28.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:28.307 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:28.308 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:28.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:28.339 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:28.339 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:28.363 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:28.364 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:28.364 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:28.364 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:28.396 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:28.396 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:28.396 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:28.396 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:29.365 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:29.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:29.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:29.463 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:29.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:29.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:29.516 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:29.525 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:29.533 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:29.534 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:29.534 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:29.592 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:29.592 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:29.592 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:29.592 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:29.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:29.613 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:29.614 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:29.671 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:29.672 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:29.672 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:29.672 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:30.593 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:30.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:30.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:30.689 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:30.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:30.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:30.741 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:30.751 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:30.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:30.800 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:30.800 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:30.844 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:30.844 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:30.844 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:30.857 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:30.857 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:30.858 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:30.858 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:30.901 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:30.902 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:30.902 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:30.902 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:31.858 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:31.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:31.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:31.955 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:31.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:31.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:32.008 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:32.018 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:32.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:32.067 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:32.067 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:32.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:32.093 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:32.093 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:32.124 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:32.124 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:32.124 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:32.124 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:32.150 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:32.150 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:32.151 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:32.151 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:33.125 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:33.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:33.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:33.223 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:33.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:33.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:33.275 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:33.285 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:33.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:33.333 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:33.333 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:33.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:33.359 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:33.360 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:33.390 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:33.391 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:33.391 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:33.391 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:33.417 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:33.418 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:33.418 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:33.418 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:34.392 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:34.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:34.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:34.492 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:34.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:34.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:34.544 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:34.553 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:34.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:34.603 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:34.603 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:34.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:34.642 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:34.642 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:34.660 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:34.660 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:34.660 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:34.660 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:34.700 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:34.700 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:34.700 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:34.700 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:35.661 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:35.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:35.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:35.717 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:35.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:35.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:35.768 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:35.778 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:35.828 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:35.828 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:35.828 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:35.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:35.852 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:35.852 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:35.886 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:35.886 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:35.886 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:35.886 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:35.909 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:35.909 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:35.909 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:35.909 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:36.887 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:36.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:36.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:36.955 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:36.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:36.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:37.007 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:37.017 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:37.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:37.066 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:37.066 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:37.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:37.091 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:37.092 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:37.122 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:37.122 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:37.123 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:37.123 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:37.150 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:37.151 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:37.151 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:37.151 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:38.124 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:38.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:38.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:38.223 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:38.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:38.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:38.276 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:38.288 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:38.296 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:38.296 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:38.296 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:38.353 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:38.353 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:38.353 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:38.353 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:38.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:38.361 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:38.361 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:38.419 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:38.419 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:38.419 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:38.419 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:39.355 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:39.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:39.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:39.453 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:39.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:39.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:39.504 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:39.514 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:39.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:39.564 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:39.564 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:39.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:39.592 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:39.592 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:39.621 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:39.621 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:39.621 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:39.621 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:39.649 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:39.649 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:39.649 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:39.649 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:40.622 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:40.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:40.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:40.719 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:40.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:40.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:40.772 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:40.781 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:40.830 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:40.830 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:40.830 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:40.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:40.872 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:40.872 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:40.888 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:40.888 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:40.888 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:40.888 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:40.929 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:40.929 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:40.929 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:40.929 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:41.889 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:41.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:41.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:41.988 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:41.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:41.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:42.041 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:42.051 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:42.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:42.099 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:42.100 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:42.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:42.122 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:42.122 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:42.156 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:42.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:42.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:42.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:42.179 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:42.180 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:42.180 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:42.180 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:43.158 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:43.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:43.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:43.257 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:43.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:43.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:43.309 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:43.319 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:43.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:43.327 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:43.327 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:43.384 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:43.384 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:43.384 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:43.384 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:43.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:43.402 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:43.402 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:43.458 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:43.459 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:43.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:43.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:44.385 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:44.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:44.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:44.483 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:44.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:44.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:44.535 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:44.545 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:44.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:44.595 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:44.596 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:44.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:44.623 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:44.623 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:44.653 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:44.653 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:44.653 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:44.653 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:44.680 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:44.680 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:44.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:44.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:45.654 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:45.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:45.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:45.753 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:45.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:45.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:45.805 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:45.815 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:45.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:45.823 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:45.823 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:45.880 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:45.880 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:45.880 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:45.880 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:45.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:45.896 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:45.897 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:45.954 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:45.955 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:45.955 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:45.955 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:46.881 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:46.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:46.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:46.980 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:46.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:46.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:47.033 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:47.042 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:47.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:47.050 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:47.050 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:47.109 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:47.109 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:47.109 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:47.109 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:47.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:47.122 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:47.122 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:47.179 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:47.179 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:47.179 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:47.179 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:48.110 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:48.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:48.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:48.209 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:48.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:48.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:48.262 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:48.272 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:48.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:48.280 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:48.280 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:48.337 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:48.337 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:48.338 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:48.338 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:48.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:48.346 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:48.346 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:48.405 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:48.406 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:48.406 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:48.406 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:49.338 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:49.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:49.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:49.436 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:49.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:49.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:49.489 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:49.499 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:49.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:49.548 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:49.548 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:49.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:49.582 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:49.582 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:49.605 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:49.605 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:49.605 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:49.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:49.639 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:49.639 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:49.639 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:49.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:50.606 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:50.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:50.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:50.705 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:50.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:50.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:50.757 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:50.767 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:50.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:50.816 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:50.817 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:50.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:50.849 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:50.849 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:50.873 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:50.873 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:50.874 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:50.874 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:50.906 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:50.906 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:50.906 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:50.906 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:51.875 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:51.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:51.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:51.973 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:51.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:51.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:52.050 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:52.061 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:52.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:52.069 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:52.070 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:52.126 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:52.126 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:52.126 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:52.126 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:52.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:52.150 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:52.150 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:52.206 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:52.206 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:52.207 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:52.207 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:53.127 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:53.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:53.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:53.225 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:53.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:53.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:53.277 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:53.287 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:53.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:53.336 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:53.337 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:53.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:53.370 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:53.370 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:53.393 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:53.393 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:53.393 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:53.393 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:53.426 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:53.426 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:53.426 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:53.426 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:54.394 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:54.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:54.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:54.495 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:54.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:54.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:54.549 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:54.558 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:54.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:54.608 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:54.608 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:54.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:54.633 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:54.633 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:54.664 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:54.664 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:54.664 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:54.664 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:54.689 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:54.690 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:54.690 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:54.690 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:55.665 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:55.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:55.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:55.766 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:55.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:55.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:55.818 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:55.828 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:55.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:55.876 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:55.876 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:55.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:55.910 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:55.910 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:55.933 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:55.934 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:55.934 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:55.934 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:55.968 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:55.969 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:55.969 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:55.969 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:56.935 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:56.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:56.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:57.033 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:57.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:57.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:57.086 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:57.096 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:57.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:57.103 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:57.103 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:57.160 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:57.160 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:57.160 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:57.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:57.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:57.171 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:57.171 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:57.229 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:57.229 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:57.229 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:57.229 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:58.161 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:58.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:58.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:58.260 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:58.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:58.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:58.312 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:58.322 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:58.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:58.330 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:58.330 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:58.386 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:58.386 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:58.386 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:58.386 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:58.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:58.404 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:58.404 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:58.461 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:58.461 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:58.461 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:58.461 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:59.387 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:27:59.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:59.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:59.485 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:27:59.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:59.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:59.538 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:27:59.547 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:27:59.596 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:27:59.596 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:59.596 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:27:59.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:27:59.629 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:59.629 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:27:59.653 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:59.653 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:59.653 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:59.653 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:59.686 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:59.687 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:59.687 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:59.687 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:00.654 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:00.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:00.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:00.753 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:00.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:00.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:00.806 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:00.815 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:00.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:00.823 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:00.823 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:00.880 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:00.880 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:00.880 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:00.880 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:00.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:00.890 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:00.890 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:00.947 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:00.948 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:00.948 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:00.948 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:01.881 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:01.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:01.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:01.959 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:01.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:01.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:02.011 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:02.021 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:02.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:02.069 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:02.069 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:02.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:02.101 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:02.101 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:02.126 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:02.126 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:02.126 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:02.126 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:02.159 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:02.159 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:02.159 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:02.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:03.127 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:03.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:03.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:03.226 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:03.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:03.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:03.278 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:03.288 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:03.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:03.296 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:03.296 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:03.352 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:03.352 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:03.352 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:03.352 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:03.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:03.362 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:03.362 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:03.418 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:03.419 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:03.419 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:03.419 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:04.353 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:04.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:04.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:04.454 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:04.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:04.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:04.506 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:04.516 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:04.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:04.564 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:04.564 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:04.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:04.589 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:04.589 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:04.621 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:04.621 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:04.621 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:04.621 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:04.646 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:04.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:04.646 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:04.646 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:05.623 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:05.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:05.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:05.720 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:05.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:05.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:05.773 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:05.783 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:05.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:05.832 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:05.832 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:05.857 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:05.857 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:05.857 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:05.888 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:05.888 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:05.888 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:05.888 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:05.914 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:05.914 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:05.914 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:05.914 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:06.889 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:06.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:06.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:06.987 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:06.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:06.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:07.040 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:07.049 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:07.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:07.098 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:07.099 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:07.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:07.130 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:07.130 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:07.155 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:07.155 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:07.155 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:07.155 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:07.186 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:07.187 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:07.187 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:07.187 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:08.156 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:08.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:08.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:08.254 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:08.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:08.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:08.306 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:08.316 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:08.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:08.324 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:08.324 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:08.382 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:08.382 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:08.382 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:08.382 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:08.401 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:08.402 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:08.402 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:08.459 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:08.459 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:08.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:08.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:09.384 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:09.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:09.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:09.482 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:09.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:09.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:09.534 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:09.544 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:09.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:09.593 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:09.593 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:09.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:09.623 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:09.623 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:09.649 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:09.649 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:09.649 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:09.649 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:09.680 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:09.681 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:09.681 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:09.681 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:10.650 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:10.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:10.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:10.748 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:10.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:10.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:10.801 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:10.810 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:10.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:10.819 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:10.819 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:10.875 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:10.875 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:10.875 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:10.875 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:10.893 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:10.893 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:10.893 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:10.951 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:10.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:10.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:10.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:11.876 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:11.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:11.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:11.976 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:11.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:11.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:12.028 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:12.038 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:12.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:12.086 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:12.087 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:12.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:12.125 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:12.125 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:12.143 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:12.143 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:12.143 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:12.143 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:12.182 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:12.182 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:12.182 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:12.182 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:13.144 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:13.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:13.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:13.242 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:13.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:13.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:13.295 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:13.304 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:13.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:13.353 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:13.353 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:13.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:13.382 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:13.382 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:13.410 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:13.410 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:13.411 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:13.411 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:13.439 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:13.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:13.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:13.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:14.412 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:14.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:14.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:14.511 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:14.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:14.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:14.564 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:14.574 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:14.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:14.624 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:14.624 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:14.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:14.658 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:14.658 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:14.682 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:14.682 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:14.682 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:14.682 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:14.715 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:14.716 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:14.716 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:14.716 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:15.683 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:15.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:15.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:15.783 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:15.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:15.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:15.835 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:15.845 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:15.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:15.894 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:15.894 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:15.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:15.917 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:15.917 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:15.950 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:15.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:15.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:15.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:15.973 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:15.973 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:15.973 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:15.973 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:16.952 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:16.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:16.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:17.052 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:17.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:17.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:17.105 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:17.115 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:17.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:17.122 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:17.122 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:17.179 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:17.179 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:17.179 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:17.179 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:17.188 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:17.188 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:17.188 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:17.246 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:17.247 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:17.247 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:17.247 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:18.180 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:18.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:18.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:18.279 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:18.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:18.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:18.331 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:18.341 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:18.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:18.390 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:18.390 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:18.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:18.420 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:18.420 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:18.447 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:18.447 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:18.447 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:18.447 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:18.477 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:18.477 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:18.477 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:18.477 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:19.448 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:19.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:19.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:19.536 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:19.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:19.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:19.589 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:19.599 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:19.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:19.606 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:19.607 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:19.664 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:19.664 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:19.664 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:19.664 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:19.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:19.673 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:19.673 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:19.732 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:19.732 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:19.732 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:19.733 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:20.665 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:20.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:20.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:20.727 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:20.734 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:20.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:20.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:20.797 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:20.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:20.808 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:20.808 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:20.865 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:20.865 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:20.865 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:20.865 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:20.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:20.872 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:20.873 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:20.930 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:20.931 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:20.931 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:20.931 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:21.866 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:21.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:21.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:21.966 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:21.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:21.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:22.019 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:22.029 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:22.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:22.037 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:22.037 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:22.094 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:22.094 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:22.094 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:22.094 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:22.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:22.103 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:22.103 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:22.160 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:22.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:22.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:22.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:23.095 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:23.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:23.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:23.193 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:23.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:23.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:23.245 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:23.255 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:23.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:23.304 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:23.305 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:23.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:23.340 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:23.341 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:23.361 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:23.361 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:23.361 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:23.361 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:23.399 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:23.399 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:23.399 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:23.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:24.362 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:24.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:24.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:24.461 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:24.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:24.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:24.513 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:24.522 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:24.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:24.569 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:24.569 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:24.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:24.613 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:24.613 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:24.627 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:24.627 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:24.627 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:24.627 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:24.672 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:24.672 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:24.672 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:24.672 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:25.628 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:25.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:25.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:25.728 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:25.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:25.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:25.779 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:25.789 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:25.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:25.840 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:25.840 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:25.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:25.864 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:25.864 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:25.896 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:25.896 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:25.897 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:25.897 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:25.921 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:25.922 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:25.922 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:25.922 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:26.897 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:26.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:26.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:26.996 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:26.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:26.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:27.048 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:27.057 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:27.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:27.065 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:27.065 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:27.122 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:27.122 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:27.122 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:27.123 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:27.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:27.128 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:27.128 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:27.185 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:27.185 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:27.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:27.185 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:28.124 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:28.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:28.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:28.221 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:28.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:28.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:28.273 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:28.283 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:28.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:28.333 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:28.333 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:28.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:28.359 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:28.359 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:28.390 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:28.390 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:28.390 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:28.390 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:28.416 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:28.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:28.416 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:28.416 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:29.391 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:29.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:29.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:29.493 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:29.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:29.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:29.546 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:29.555 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:29.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:29.604 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:29.605 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:29.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:29.631 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:29.631 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:29.661 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:29.662 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:29.662 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:29.662 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:29.688 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:29.689 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:29.689 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:29.689 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:30.663 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:30.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:30.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:30.762 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:30.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:30.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:30.814 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:30.824 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:30.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:30.873 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:30.873 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:30.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:30.903 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:30.903 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:30.928 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:30.929 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:30.929 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:30.929 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:30.960 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:30.960 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:30.960 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:30.960 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:31.930 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:31.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:31.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:32.029 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:32.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:32.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:32.081 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:32.091 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:32.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:32.139 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:32.140 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:32.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:32.175 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:32.175 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:32.196 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:32.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:32.196 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:32.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:32.233 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:32.233 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:32.233 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:32.233 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:33.198 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:33.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:33.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:33.296 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:33.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:33.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:33.348 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:33.358 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:33.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:33.409 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:33.409 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:33.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:33.441 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:33.441 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:33.464 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:33.465 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:33.465 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:33.465 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:33.498 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:33.498 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:33.498 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:33.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:34.466 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:34.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:34.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:34.564 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:34.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:34.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:34.616 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:34.626 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:34.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:34.676 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:34.676 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:34.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:34.711 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:34.711 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:34.732 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:34.732 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:34.732 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:34.732 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:34.769 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:34.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:34.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:34.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:35.733 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:35.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:35.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:35.832 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:35.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:35.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:35.883 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:35.893 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:35.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:35.941 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:35.941 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:35.964 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:35.964 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:35.964 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:35.999 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:36.000 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:36.000 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:36.000 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:36.022 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:36.022 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:36.022 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:36.023 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:37.002 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:37.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:37.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:37.101 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:37.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:37.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:37.154 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:37.163 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:37.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:37.171 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:37.171 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:37.228 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:37.229 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:37.229 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:37.229 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:37.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:37.243 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:37.243 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:37.299 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:37.299 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:37.299 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:37.300 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:38.230 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:38.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:38.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:38.328 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:38.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:38.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:38.381 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:38.391 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:38.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:38.398 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:38.398 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:38.454 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:38.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:38.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:38.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:38.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:38.464 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:38.464 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:38.523 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:38.523 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:38.523 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:38.524 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:39.455 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:39.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:39.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:39.554 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:39.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:39.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:39.606 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:39.615 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:39.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:39.665 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:39.665 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:39.686 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:39.686 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:39.687 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:39.722 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:39.722 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:39.722 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:39.722 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:39.744 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:39.744 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:39.744 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:39.744 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:40.723 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:40.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:40.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:40.821 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:40.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:40.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:40.874 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:40.884 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:40.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:40.933 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:40.933 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:40.957 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:40.957 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:40.957 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:40.989 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:40.989 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:40.989 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:40.989 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:41.014 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:41.014 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:41.015 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:41.015 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:41.990 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:41.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:41.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:42.088 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:42.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:42.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:42.141 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:42.151 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:42.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:42.200 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:42.200 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:42.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:42.234 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:42.234 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:42.258 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:42.259 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:42.259 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:42.259 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:42.291 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:42.292 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:42.292 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:42.292 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:43.260 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:43.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:43.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:43.357 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:43.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:43.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:43.409 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:43.419 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:43.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:43.469 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:43.469 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:43.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:43.505 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:43.505 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:43.526 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:43.526 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:43.526 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:43.526 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:43.562 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:43.562 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:43.562 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:43.562 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:44.527 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:44.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:44.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:44.625 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:44.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:44.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:44.678 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:44.687 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:44.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:44.737 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:44.737 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:44.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:44.770 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:44.770 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:44.793 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:44.794 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:44.794 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:44.794 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:44.827 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:44.827 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:44.828 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:44.828 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:45.795 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:28:45.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:45.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:45.894 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:28:45.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:45.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:45.946 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:28:45.956 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:28:46.005 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:28:46.005 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:46.005 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:28:46.035 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:28:46.035 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:46.036 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:28:46.061 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:46.062 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:46.062 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:46.062 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:46.093 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:46.094 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:46.094 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:46.094 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:46.095 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:46.097 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:28:46.113 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:28:46.145 INFO:teuthology.run:Summary data: description: fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds-flush} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:28:46.145 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:28:46.276 INFO:teuthology.run:FAIL