2026-02-12T22:29:57.414 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:29:57.431 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:29:57.512 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47220 branch: wip-pdonnell-testing-20260210.171210 description: fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/pool-perm} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47220' kernel: client: sha1: distro sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: syntax: v2 selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial013.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIngZRI+FkDdTNGD1j6WEvLFZ2j18fam9/Hg6UZ6+rMe53MdmsLqJQCXIEXdKwzPaj2uWPjO10WGJCwgzO7uWIU= trial123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJmgnArBPLBw7RdHLfkdXdlzgHJHXW2IRytItBWjBx8XotSlsZqIsGBLBObcRNGrJ0mFdz4btJ2ghMOCCyXewnc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - kclient: null - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:29:57.512 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:29:57.512 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:29:57.512 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:29:57.514 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:29:57.514 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:29:57.514 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:29:57.514 INFO:teuthology.packaging:ref: None 2026-02-12T22:29:57.514 INFO:teuthology.packaging:tag: None 2026-02-12T22:29:57.514 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:29:57.514 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:29:57.514 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:29:57.633 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:29:57.634 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:29:57.645 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:29:57.645 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:29:57.665 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:29:57.674 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:29:57.686 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:29:57.742 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial013.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47220', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:26:34.603846', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIngZRI+FkDdTNGD1j6WEvLFZ2j18fam9/Hg6UZ6+rMe53MdmsLqJQCXIEXdKwzPaj2uWPjO10WGJCwgzO7uWIU='} 2026-02-12T22:29:57.797 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial123.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47220', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:26:34.603134', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJmgnArBPLBw7RdHLfkdXdlzgHJHXW2IRytItBWjBx8XotSlsZqIsGBLBObcRNGrJ0mFdz4btJ2ghMOCCyXewnc='} 2026-02-12T22:29:57.797 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:29:57.809 INFO:teuthology.task.internal:roles: ubuntu@trial013.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2026-02-12T22:29:57.809 INFO:teuthology.task.internal:roles: ubuntu@trial123.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2026-02-12T22:29:57.809 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:29:57.943 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x775b8c9f0860>, signals=[15]) 2026-02-12T22:29:57.943 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:29:57.955 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:29:57.955 DEBUG:teuthology.task.internal:connecting to ubuntu@trial013.front.sepia.ceph.com 2026-02-12T22:29:57.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:58.015 DEBUG:teuthology.task.internal:connecting to ubuntu@trial123.front.sepia.ceph.com 2026-02-12T22:29:58.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:58.074 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:29:58.086 DEBUG:teuthology.orchestra.run.trial013:> uname -m 2026-02-12T22:29:58.102 INFO:teuthology.orchestra.run.trial013.stdout:x86_64 2026-02-12T22:29:58.102 DEBUG:teuthology.orchestra.run.trial013:> cat /etc/os-release 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:NAME="Rocky Linux" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:ID="rocky" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:VERSION_ID="10.1" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:ANSI_COLOR="0;32" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:VENDOR_NAME="RESF" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:29:58.160 INFO:teuthology.orchestra.run.trial013.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:29:58.161 INFO:teuthology.orchestra.run.trial013.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:29:58.161 INFO:teuthology.lock.ops:Updating trial013.front.sepia.ceph.com on lock server 2026-02-12T22:29:58.235 DEBUG:teuthology.orchestra.run.trial123:> uname -m 2026-02-12T22:29:58.252 INFO:teuthology.orchestra.run.trial123.stdout:x86_64 2026-02-12T22:29:58.252 DEBUG:teuthology.orchestra.run.trial123:> cat /etc/os-release 2026-02-12T22:29:58.308 INFO:teuthology.orchestra.run.trial123.stdout:NAME="Rocky Linux" 2026-02-12T22:29:58.308 INFO:teuthology.orchestra.run.trial123.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:29:58.308 INFO:teuthology.orchestra.run.trial123.stdout:ID="rocky" 2026-02-12T22:29:58.308 INFO:teuthology.orchestra.run.trial123.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:29:58.309 INFO:teuthology.orchestra.run.trial123.stdout:VERSION_ID="10.1" 2026-02-12T22:29:58.309 INFO:teuthology.orchestra.run.trial123.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:29:58.309 INFO:teuthology.orchestra.run.trial123.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:29:58.309 INFO:teuthology.orchestra.run.trial123.stdout:ANSI_COLOR="0;32" 2026-02-12T22:29:58.309 INFO:teuthology.orchestra.run.trial123.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:29:58.309 INFO:teuthology.orchestra.run.trial123.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:29:58.309 INFO:teuthology.orchestra.run.trial123.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:29:58.309 INFO:teuthology.orchestra.run.trial123.stdout:VENDOR_NAME="RESF" 2026-02-12T22:29:58.309 INFO:teuthology.orchestra.run.trial123.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:29:58.309 INFO:teuthology.orchestra.run.trial123.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:29:58.309 INFO:teuthology.orchestra.run.trial123.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:29:58.309 INFO:teuthology.orchestra.run.trial123.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:29:58.309 INFO:teuthology.orchestra.run.trial123.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:29:58.309 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:29:58.309 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:29:58.309 INFO:teuthology.lock.ops:Updating trial123.front.sepia.ceph.com on lock server 2026-02-12T22:29:58.382 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:29:58.394 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:29:58.406 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:29:58.406 DEBUG:teuthology.orchestra.run.trial013:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:29:58.408 DEBUG:teuthology.orchestra.run.trial123:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:29:58.425 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:29:58.436 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:29:58.436 DEBUG:teuthology.orchestra.run.trial013:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:29:58.465 DEBUG:teuthology.orchestra.run.trial123:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:29:58.480 INFO:teuthology.orchestra.run.trial013.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:29:58.482 INFO:teuthology.orchestra.run.trial123.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:29:58.483 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:29:58.638 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:29:58.657 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'sha1': 'distro'} 2026-02-12T22:29:58.657 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2026-02-12T22:29:58.657 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:29:58.657 DEBUG:teuthology.orchestra.run.trial013:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:29:58.657 DEBUG:teuthology.orchestra.run.trial123:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:29:58.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:29:58.673 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:29:58.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:29:58.674 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:29:58.730 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:58.730 INFO:teuthology.task.kernel:Running kernel on trial013: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:58.730 DEBUG:teuthology.orchestra.run.trial013:> sudo yum install -y kernel 2026-02-12T22:29:58.730 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:58.731 INFO:teuthology.task.kernel:Running kernel on trial123: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:58.731 DEBUG:teuthology.orchestra.run.trial123:> sudo yum install -y kernel 2026-02-12T22:29:59.300 INFO:teuthology.orchestra.run.trial013.stdout:Rocky Linux 10 - AppStream 13 MB/s | 2.2 MB 00:00 2026-02-12T22:29:59.361 INFO:teuthology.orchestra.run.trial123.stdout:Rocky Linux 10 - AppStream 9.6 MB/s | 2.2 MB 00:00 2026-02-12T22:29:59.670 INFO:teuthology.orchestra.run.trial013.stdout:Rocky Linux 10 - BaseOS 45 MB/s | 11 MB 00:00 2026-02-12T22:29:59.813 INFO:teuthology.orchestra.run.trial123.stdout:Rocky Linux 10 - BaseOS 33 MB/s | 11 MB 00:00 2026-02-12T22:30:00.202 INFO:teuthology.orchestra.run.trial013.stdout:Rocky Linux 10 - CRB 4.2 MB/s | 507 kB 00:00 2026-02-12T22:30:00.323 INFO:teuthology.orchestra.run.trial123.stdout:Rocky Linux 10 - CRB 5.0 MB/s | 507 kB 00:00 2026-02-12T22:30:00.830 INFO:teuthology.orchestra.run.trial123.stdout:Extra Packages for Enterprise Linux 14 MB/s | 6.2 MB 00:00 2026-02-12T22:30:00.974 INFO:teuthology.orchestra.run.trial013.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 6.2 MB 00:00 2026-02-12T22:30:01.493 INFO:teuthology.orchestra.run.trial123.stdout:lab-extras 191 kB/s | 3.7 kB 00:00 2026-02-12T22:30:01.624 INFO:teuthology.orchestra.run.trial013.stdout:lab-extras 309 kB/s | 3.7 kB 00:00 2026-02-12T22:30:01.901 INFO:teuthology.orchestra.run.trial123.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:30:01.913 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-12T22:30:01.914 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-12T22:30:01.914 INFO:teuthology.orchestra.run.trial123.stdout: Package Arch Version Repo Size 2026-02-12T22:30:01.914 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-12T22:30:01.914 INFO:teuthology.orchestra.run.trial123.stdout:Installing: 2026-02-12T22:30:01.915 INFO:teuthology.orchestra.run.trial123.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:30:01.915 INFO:teuthology.orchestra.run.trial123.stdout:Installing dependencies: 2026-02-12T22:30:01.915 INFO:teuthology.orchestra.run.trial123.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:30:01.915 INFO:teuthology.orchestra.run.trial123.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:30:01.915 INFO:teuthology.orchestra.run.trial123.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:30:01.915 INFO:teuthology.orchestra.run.trial123.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:30:01.915 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-12T22:30:01.915 INFO:teuthology.orchestra.run.trial123.stdout:Transaction Summary 2026-02-12T22:30:01.915 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-12T22:30:01.915 INFO:teuthology.orchestra.run.trial123.stdout:Install 5 Packages 2026-02-12T22:30:01.915 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-12T22:30:01.916 INFO:teuthology.orchestra.run.trial123.stdout:Total download size: 93 M 2026-02-12T22:30:01.916 INFO:teuthology.orchestra.run.trial123.stdout:Installed size: 135 M 2026-02-12T22:30:01.916 INFO:teuthology.orchestra.run.trial123.stdout:Downloading Packages: 2026-02-12T22:30:01.985 INFO:teuthology.orchestra.run.trial123.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2026-02-12T22:30:02.034 INFO:teuthology.orchestra.run.trial013.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:30:02.046 INFO:teuthology.orchestra.run.trial013.stdout:Dependencies resolved. 2026-02-12T22:30:02.047 INFO:teuthology.orchestra.run.trial013.stdout:================================================================================ 2026-02-12T22:30:02.047 INFO:teuthology.orchestra.run.trial013.stdout: Package Arch Version Repo Size 2026-02-12T22:30:02.047 INFO:teuthology.orchestra.run.trial013.stdout:================================================================================ 2026-02-12T22:30:02.047 INFO:teuthology.orchestra.run.trial013.stdout:Installing: 2026-02-12T22:30:02.047 INFO:teuthology.orchestra.run.trial013.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:30:02.048 INFO:teuthology.orchestra.run.trial013.stdout:Installing dependencies: 2026-02-12T22:30:02.048 INFO:teuthology.orchestra.run.trial013.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:30:02.048 INFO:teuthology.orchestra.run.trial013.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:30:02.048 INFO:teuthology.orchestra.run.trial013.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:30:02.048 INFO:teuthology.orchestra.run.trial013.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:30:02.048 INFO:teuthology.orchestra.run.trial013.stdout: 2026-02-12T22:30:02.048 INFO:teuthology.orchestra.run.trial013.stdout:Transaction Summary 2026-02-12T22:30:02.048 INFO:teuthology.orchestra.run.trial013.stdout:================================================================================ 2026-02-12T22:30:02.048 INFO:teuthology.orchestra.run.trial013.stdout:Install 5 Packages 2026-02-12T22:30:02.048 INFO:teuthology.orchestra.run.trial013.stdout: 2026-02-12T22:30:02.049 INFO:teuthology.orchestra.run.trial013.stdout:Total download size: 93 M 2026-02-12T22:30:02.049 INFO:teuthology.orchestra.run.trial013.stdout:Installed size: 135 M 2026-02-12T22:30:02.049 INFO:teuthology.orchestra.run.trial013.stdout:Downloading Packages: 2026-02-12T22:30:02.100 INFO:teuthology.orchestra.run.trial013.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 27 MB/s | 1.4 MB 00:00 2026-02-12T22:30:02.376 INFO:teuthology.orchestra.run.trial013.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 56 MB/s | 18 MB 00:00 2026-02-12T22:30:02.423 INFO:teuthology.orchestra.run.trial013.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 60 MB/s | 2.8 MB 00:00 2026-02-12T22:30:02.480 INFO:teuthology.orchestra.run.trial013.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 78 MB/s | 30 MB 00:00 2026-02-12T22:30:02.507 INFO:teuthology.orchestra.run.trial123.stdout:(2/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 69 MB/s | 41 MB 00:00 2026-02-12T22:30:02.553 INFO:teuthology.orchestra.run.trial123.stdout:(3/5): kernel-modules-core-6.12.0-124.31.1.el10 52 MB/s | 30 MB 00:00 2026-02-12T22:30:02.593 INFO:teuthology.orchestra.run.trial123.stdout:(4/5): kernel-modules-extra-6.12.0-124.31.1.el1 32 MB/s | 2.8 MB 00:00 2026-02-12T22:30:02.710 INFO:teuthology.orchestra.run.trial013.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 61 MB/s | 41 MB 00:00 2026-02-12T22:30:02.710 INFO:teuthology.orchestra.run.trial013.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:30:02.711 INFO:teuthology.orchestra.run.trial013.stdout:Total 140 MB/s | 93 MB 00:00 2026-02-12T22:30:02.711 INFO:teuthology.orchestra.run.trial013.stdout:Running transaction check 2026-02-12T22:30:02.780 INFO:teuthology.orchestra.run.trial123.stdout:(5/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 21 MB/s | 18 MB 00:00 2026-02-12T22:30:02.781 INFO:teuthology.orchestra.run.trial123.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:30:02.781 INFO:teuthology.orchestra.run.trial123.stdout:Total 107 MB/s | 93 MB 00:00 2026-02-12T22:30:02.781 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction check 2026-02-12T22:30:02.858 INFO:teuthology.orchestra.run.trial013.stdout:Transaction check succeeded. 2026-02-12T22:30:02.858 INFO:teuthology.orchestra.run.trial013.stdout:Running transaction test 2026-02-12T22:30:02.928 INFO:teuthology.orchestra.run.trial123.stdout:Transaction check succeeded. 2026-02-12T22:30:02.928 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction test 2026-02-12T22:30:03.259 INFO:teuthology.orchestra.run.trial013.stdout:Transaction test succeeded. 2026-02-12T22:30:03.260 INFO:teuthology.orchestra.run.trial013.stdout:Running transaction 2026-02-12T22:30:03.331 INFO:teuthology.orchestra.run.trial123.stdout:Transaction test succeeded. 2026-02-12T22:30:03.331 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction 2026-02-12T22:30:03.956 INFO:teuthology.orchestra.run.trial013.stdout: Preparing : 1/1 2026-02-12T22:30:04.022 INFO:teuthology.orchestra.run.trial123.stdout: Preparing : 1/1 2026-02-12T22:30:04.157 INFO:teuthology.orchestra.run.trial013.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:30:04.178 INFO:teuthology.orchestra.run.trial013.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:30:04.226 INFO:teuthology.orchestra.run.trial123.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:30:04.247 INFO:teuthology.orchestra.run.trial123.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:30:05.428 INFO:teuthology.orchestra.run.trial013.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:30:05.455 INFO:teuthology.orchestra.run.trial013.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:30:05.498 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:30:05.526 INFO:teuthology.orchestra.run.trial123.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:30:07.299 INFO:teuthology.orchestra.run.trial013.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:30:07.304 INFO:teuthology.orchestra.run.trial013.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:30:07.372 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:30:07.378 INFO:teuthology.orchestra.run.trial123.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:30:09.161 INFO:teuthology.orchestra.run.trial013.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:30:09.171 INFO:teuthology.orchestra.run.trial013.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:30:09.241 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:30:09.252 INFO:teuthology.orchestra.run.trial123.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:30:11.030 INFO:teuthology.orchestra.run.trial013.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:30:11.123 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:30:44.628 INFO:teuthology.orchestra.run.trial013.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:30:44.651 INFO:teuthology.orchestra.run.trial013.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:30:44.817 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:30:44.839 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:30:44.884 INFO:teuthology.orchestra.run.trial013.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:30:44.884 INFO:teuthology.orchestra.run.trial013.stdout: 2026-02-12T22:30:44.884 INFO:teuthology.orchestra.run.trial013.stdout:Installed: 2026-02-12T22:30:44.884 INFO:teuthology.orchestra.run.trial013.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:44.884 INFO:teuthology.orchestra.run.trial013.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:44.884 INFO:teuthology.orchestra.run.trial013.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:44.884 INFO:teuthology.orchestra.run.trial013.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:44.884 INFO:teuthology.orchestra.run.trial013.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:44.885 INFO:teuthology.orchestra.run.trial013.stdout: 2026-02-12T22:30:44.885 INFO:teuthology.orchestra.run.trial013.stdout:Complete! 2026-02-12T22:30:44.948 DEBUG:teuthology.orchestra.run.trial013:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:30:44.983 INFO:teuthology.orchestra.run.trial013.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:44.983 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:44.984 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:44.984 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:30:44.984 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:30:44.984 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2026-02-12T22:30:44.984 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial013.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:30:44.984 DEBUG:teuthology.orchestra.run.trial013:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:30:45.056 INFO:teuthology.orchestra.run.trial013.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.057 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.058 DEBUG:teuthology.orchestra.run.trial013:> sudo rpm -qi grub2-tools 2026-02-12T22:30:45.069 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:30:45.069 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-12T22:30:45.069 INFO:teuthology.orchestra.run.trial123.stdout:Installed: 2026-02-12T22:30:45.069 INFO:teuthology.orchestra.run.trial123.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.069 INFO:teuthology.orchestra.run.trial123.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.070 INFO:teuthology.orchestra.run.trial123.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.070 INFO:teuthology.orchestra.run.trial123.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.070 INFO:teuthology.orchestra.run.trial123.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.070 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-12T22:30:45.070 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-12T22:30:45.130 INFO:teuthology.orchestra.run.trial013.stdout:Name : grub2-tools 2026-02-12T22:30:45.130 INFO:teuthology.orchestra.run.trial013.stdout:Epoch : 1 2026-02-12T22:30:45.130 INFO:teuthology.orchestra.run.trial013.stdout:Version : 2.12 2026-02-12T22:30:45.130 INFO:teuthology.orchestra.run.trial013.stdout:Release : 29.el10_1 2026-02-12T22:30:45.131 INFO:teuthology.orchestra.run.trial013.stdout:Architecture: x86_64 2026-02-12T22:30:45.131 INFO:teuthology.orchestra.run.trial013.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:30:45.131 INFO:teuthology.orchestra.run.trial013.stdout:Group : Unspecified 2026-02-12T22:30:45.131 INFO:teuthology.orchestra.run.trial013.stdout:Size : 7963769 2026-02-12T22:30:45.131 INFO:teuthology.orchestra.run.trial013.stdout:License : GPL-3.0-or-later 2026-02-12T22:30:45.131 INFO:teuthology.orchestra.run.trial013.stdout:Signature : 2026-02-12T22:30:45.131 INFO:teuthology.orchestra.run.trial013.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:30:45.132 INFO:teuthology.orchestra.run.trial013.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:30:45.132 INFO:teuthology.orchestra.run.trial013.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:30:45.132 INFO:teuthology.orchestra.run.trial013.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:30:45.132 INFO:teuthology.orchestra.run.trial013.stdout:Packager : Release Engineering 2026-02-12T22:30:45.132 INFO:teuthology.orchestra.run.trial013.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:30:45.132 INFO:teuthology.orchestra.run.trial013.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:30:45.132 INFO:teuthology.orchestra.run.trial013.stdout:Summary : Support tools for GRUB. 2026-02-12T22:30:45.132 INFO:teuthology.orchestra.run.trial013.stdout:Description : 2026-02-12T22:30:45.133 INFO:teuthology.orchestra.run.trial013.stdout: 2026-02-12T22:30:45.133 INFO:teuthology.orchestra.run.trial013.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:30:45.133 INFO:teuthology.orchestra.run.trial013.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:30:45.133 INFO:teuthology.orchestra.run.trial013.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:30:45.133 INFO:teuthology.orchestra.run.trial013.stdout:hardware devices. 2026-02-12T22:30:45.133 INFO:teuthology.orchestra.run.trial013.stdout: 2026-02-12T22:30:45.133 INFO:teuthology.orchestra.run.trial013.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:30:45.136 DEBUG:teuthology.orchestra.run.trial123:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:30:45.137 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:30:45.137 INFO:teuthology.task.kernel:Updating grub on trial013 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.137 DEBUG:teuthology.orchestra.run.trial013:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:30:45.170 INFO:teuthology.orchestra.run.trial123.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.170 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.170 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.171 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:30:45.171 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:30:45.171 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2026-02-12T22:30:45.171 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial123.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:30:45.171 DEBUG:teuthology.orchestra.run.trial123:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:30:45.201 INFO:teuthology.orchestra.run.trial013.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:30:45.202 DEBUG:teuthology.orchestra.run.trial013:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:30:45.244 INFO:teuthology.orchestra.run.trial123.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.245 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.245 DEBUG:teuthology.orchestra.run.trial123:> sudo rpm -qi grub2-tools 2026-02-12T22:30:45.269 INFO:teuthology.orchestra.run.trial013.stdout:/sbin/grubby 2026-02-12T22:30:45.270 INFO:teuthology.orchestra.run.trial013.stdout:yes 2026-02-12T22:30:45.270 DEBUG:teuthology.orchestra.run.trial013:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:30:45.316 INFO:teuthology.orchestra.run.trial123.stdout:Name : grub2-tools 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout:Epoch : 1 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout:Version : 2.12 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout:Release : 29.el10_1 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout:Architecture: x86_64 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout:Group : Unspecified 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout:Size : 7963769 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout:License : GPL-3.0-or-later 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout:Signature : 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout:Packager : Release Engineering 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:30:45.317 INFO:teuthology.orchestra.run.trial123.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:30:45.318 INFO:teuthology.orchestra.run.trial123.stdout:Summary : Support tools for GRUB. 2026-02-12T22:30:45.318 INFO:teuthology.orchestra.run.trial123.stdout:Description : 2026-02-12T22:30:45.318 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-12T22:30:45.318 INFO:teuthology.orchestra.run.trial123.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:30:45.318 INFO:teuthology.orchestra.run.trial123.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:30:45.318 INFO:teuthology.orchestra.run.trial123.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:30:45.318 INFO:teuthology.orchestra.run.trial123.stdout:hardware devices. 2026-02-12T22:30:45.318 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-12T22:30:45.318 INFO:teuthology.orchestra.run.trial123.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:30:45.319 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:30:45.319 INFO:teuthology.task.kernel:Updating grub on trial123 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.319 DEBUG:teuthology.orchestra.run.trial123:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:30:45.337 INFO:teuthology.orchestra.run.trial013.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:30:45.338 DEBUG:teuthology.orchestra.run.trial013:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.384 INFO:teuthology.orchestra.run.trial123.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:30:45.386 DEBUG:teuthology.orchestra.run.trial123:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:30:45.413 DEBUG:teuthology.orchestra.run.trial013:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:30:45.452 INFO:teuthology.orchestra.run.trial123.stdout:/sbin/grubby 2026-02-12T22:30:45.453 INFO:teuthology.orchestra.run.trial123.stdout:yes 2026-02-12T22:30:45.454 DEBUG:teuthology.orchestra.run.trial123:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:30:45.521 INFO:teuthology.orchestra.run.trial123.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:30:45.521 DEBUG:teuthology.orchestra.run.trial123:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.523 INFO:teuthology.orchestra.run.trial013.stderr:Generating grub configuration file ... 2026-02-12T22:30:45.597 DEBUG:teuthology.orchestra.run.trial123:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:30:45.698 INFO:teuthology.orchestra.run.trial013.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:30:45.707 INFO:teuthology.orchestra.run.trial123.stderr:Generating grub configuration file ... 2026-02-12T22:30:45.708 INFO:teuthology.orchestra.run.trial013.stderr:done 2026-02-12T22:30:45.710 DEBUG:teuthology.orchestra.run.trial013:> test -d /sys/firmware/efi 2026-02-12T22:30:45.727 DEBUG:teuthology.orchestra.run.trial013:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:30:45.799 INFO:teuthology.orchestra.run.trial013.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:30:45.799 INFO:teuthology.orchestra.run.trial013.stdout:/boot/efi/EFI/rocky 2026-02-12T22:30:45.801 DEBUG:teuthology.orchestra.run.trial013:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:30:45.868 INFO:teuthology.orchestra.run.trial013.stdout:no 2026-02-12T22:30:45.869 DEBUG:teuthology.orchestra.run.trial013:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:30:45.883 INFO:teuthology.orchestra.run.trial123.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:30:45.893 INFO:teuthology.orchestra.run.trial123.stderr:done 2026-02-12T22:30:45.894 DEBUG:teuthology.orchestra.run.trial123:> test -d /sys/firmware/efi 2026-02-12T22:30:45.911 DEBUG:teuthology.orchestra.run.trial123:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:30:45.934 INFO:teuthology.orchestra.run.trial013.stdout:yes 2026-02-12T22:30:45.934 DEBUG:teuthology.orchestra.run.trial013:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:30:45.979 INFO:teuthology.orchestra.run.trial123.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:30:45.979 INFO:teuthology.orchestra.run.trial123.stdout:/boot/efi/EFI/rocky 2026-02-12T22:30:45.981 DEBUG:teuthology.orchestra.run.trial123:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:30:46.001 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial013 2026-02-12T22:30:46.001 DEBUG:teuthology.orchestra.run.trial013:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:30:46.047 INFO:teuthology.orchestra.run.trial123.stdout:no 2026-02-12T22:30:46.047 DEBUG:teuthology.orchestra.run.trial123:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:30:46.066 INFO:teuthology.orchestra.run.trial013.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:30:46.114 INFO:teuthology.orchestra.run.trial123.stdout:yes 2026-02-12T22:30:46.114 DEBUG:teuthology.orchestra.run.trial123:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:30:46.180 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial123 2026-02-12T22:30:46.181 DEBUG:teuthology.orchestra.run.trial123:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:30:46.246 INFO:teuthology.orchestra.run.trial123.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:31:16.043 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:16.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:16.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:16.151 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:16.224 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:16.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:16.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:16.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:16.300 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:16.300 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:16.310 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:16.360 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:16.360 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:16.360 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:16.360 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:16.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:16.396 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:16.396 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:16.455 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:16.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:16.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:16.456 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:17.362 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:17.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:17.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:17.462 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:17.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:17.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:17.514 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:17.523 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:17.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:17.531 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:17.532 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:17.589 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:17.589 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:17.589 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:17.589 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:17.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:17.601 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:17.601 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:17.658 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:17.658 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:17.658 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:17.658 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:18.591 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:18.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:18.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:18.689 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:18.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:18.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:18.741 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:18.751 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:18.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:18.759 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:18.759 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:18.815 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:18.816 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:18.816 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:18.816 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:18.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:18.826 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:18.826 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:18.883 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:18.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:18.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:18.883 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:19.817 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:19.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:19.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:19.915 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:19.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:19.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:19.967 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:19.977 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:19.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:19.984 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:19.984 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:20.041 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:20.041 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:20.041 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:20.041 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:20.061 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:20.061 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:20.061 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:20.119 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:20.119 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:20.119 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:20.119 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:21.041 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:21.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:21.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:21.140 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:21.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:21.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:21.195 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:21.204 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:21.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:21.212 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:21.212 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:21.271 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:21.271 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:21.271 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:21.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:21.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:21.284 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:21.284 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:21.341 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:21.342 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:21.342 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:21.342 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:22.273 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:22.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:22.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:22.332 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:22.343 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:22.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:22.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:22.408 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:22.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:22.422 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:22.422 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:22.479 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:22.479 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:22.479 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:22.479 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:22.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:22.497 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:22.497 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:22.553 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:22.553 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:22.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:22.553 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:23.479 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:23.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:23.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:23.539 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:23.554 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:23.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:23.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:23.618 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:23.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:23.626 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:23.626 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:23.683 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:23.683 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:23.683 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:23.683 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:23.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:23.692 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:23.692 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:23.748 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:23.748 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:23.748 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:23.748 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:24.684 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:24.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:24.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:24.783 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:24.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:24.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:24.835 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:24.845 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:24.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:24.853 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:24.853 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:24.910 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:24.910 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:24.911 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:24.911 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:24.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:24.921 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:24.921 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:24.978 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:24.978 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:24.978 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:24.978 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:25.912 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:25.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:25.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:26.010 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:26.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:26.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:26.062 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:26.072 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:26.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:26.079 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:26.080 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:26.136 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:26.136 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:26.136 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:26.136 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:26.148 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:26.148 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:26.148 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:26.205 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:26.205 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:26.206 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:26.206 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:27.137 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:27.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:27.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:27.234 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:27.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:27.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:27.286 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:27.295 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:27.303 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:27.303 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:27.303 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:27.361 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:27.361 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:27.361 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:27.361 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:27.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:27.369 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:27.369 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:27.427 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:27.427 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:27.427 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:27.427 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:28.362 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:28.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:28.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:28.460 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:28.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:28.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:28.512 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:28.522 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:28.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:28.530 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:28.530 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:28.586 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:28.586 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:28.586 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:28.586 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:28.609 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:28.609 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:28.609 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:28.667 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:28.668 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:28.668 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:28.668 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:29.587 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:29.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:29.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:29.685 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:29.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:29.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:29.738 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:29.747 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:29.755 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:29.755 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:29.755 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:29.812 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:29.812 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:29.812 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:29.812 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:29.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:29.821 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:29.821 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:29.878 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:29.878 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:29.878 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:29.878 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:30.813 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:30.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:30.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:30.910 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:30.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:30.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:30.963 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:30.972 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:30.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:30.980 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:30.980 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:31.036 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:31.036 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:31.036 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:31.036 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:31.058 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:31.058 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:31.058 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:31.115 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:31.115 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:31.115 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:31.116 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:32.037 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:32.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:32.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:32.136 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:32.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:32.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:32.188 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:32.197 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:32.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:32.205 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:32.205 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:32.263 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:32.263 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:32.263 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:32.263 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:32.276 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:32.276 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:32.276 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:32.333 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:32.333 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:32.333 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:32.333 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:33.264 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:33.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:33.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:33.363 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:33.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:33.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:33.415 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:33.424 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:33.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:33.432 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:33.432 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:33.489 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:33.489 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:33.489 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:33.489 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:33.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:33.502 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:33.502 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:33.559 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:33.559 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:33.559 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:33.559 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:34.491 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:34.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:34.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:34.589 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:34.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:34.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:34.641 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:34.651 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:34.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:34.659 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:34.659 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:34.716 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:34.716 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:34.716 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:34.716 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:34.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:34.735 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:34.735 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:34.793 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:34.793 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:34.793 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:34.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:35.717 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:35.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:35.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:35.814 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:35.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:35.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:35.866 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:35.876 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:35.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:35.884 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:35.884 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:35.940 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:35.940 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:35.940 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:35.940 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:35.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:35.958 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:35.958 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:36.016 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:36.016 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:36.016 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:36.016 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:36.942 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:36.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:36.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:37.038 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:37.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:37.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:37.090 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:37.100 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:37.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:37.108 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:37.108 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:37.164 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:37.164 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:37.164 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:37.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:37.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:37.181 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:37.181 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:37.237 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:37.238 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:37.238 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:37.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:38.165 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:38.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:38.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:38.264 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:38.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:38.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:38.316 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:38.339 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:38.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:38.339 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:38.339 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:38.396 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:38.396 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:38.396 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:38.396 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:38.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:38.409 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:38.409 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:38.465 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:38.466 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:38.466 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:38.466 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:39.397 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:39.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:39.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:39.496 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:39.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:39.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:39.548 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:39.557 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:39.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:39.565 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:39.565 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:39.622 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:39.622 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:39.622 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:39.623 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:39.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:39.638 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:39.638 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:39.695 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:39.695 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:39.695 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:39.696 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:40.624 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:40.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:40.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:40.724 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:40.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:40.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:40.776 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:40.785 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:40.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:40.794 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:40.794 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:40.850 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:40.851 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:40.851 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:40.851 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:40.867 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:40.868 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:40.868 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:40.925 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:40.925 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:40.925 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:40.925 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:41.852 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:41.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:41.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:41.951 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:41.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:41.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:42.003 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:42.012 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:42.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:42.021 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:42.021 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:42.077 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:42.077 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:42.077 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:42.077 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:42.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:42.099 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:42.099 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:42.157 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:42.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:42.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:42.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:43.079 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:43.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:43.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:43.178 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:43.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:43.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:43.231 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:43.240 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:43.248 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:43.248 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:43.248 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:43.305 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:43.305 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:43.305 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:43.305 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:43.329 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:43.329 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:43.329 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:43.387 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:43.387 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:43.387 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:43.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:44.306 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:44.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:44.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:44.405 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:44.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:44.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:44.458 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:44.467 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:44.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:44.475 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:44.475 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:44.532 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:44.532 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:44.532 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:44.532 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:44.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:44.556 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:44.556 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:44.614 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:44.614 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:44.614 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:44.615 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:45.533 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:45.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:45.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:45.630 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:45.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:45.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:45.683 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:45.692 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:45.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:45.700 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:45.700 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:45.756 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:45.756 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:45.756 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:45.756 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:45.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:45.771 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:45.771 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:45.830 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:45.830 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:45.831 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:45.831 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:46.758 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:46.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:46.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:46.856 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:46.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:46.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:46.909 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:46.919 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:46.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:46.927 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:46.927 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:46.983 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:46.984 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:46.984 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:46.984 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:47.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:47.003 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:47.003 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:47.060 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:47.061 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:47.061 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:47.061 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:47.985 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:47.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:47.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:48.084 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:48.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:48.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:48.136 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:48.145 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:48.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:48.154 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:48.154 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:48.210 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:48.211 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:48.211 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:48.211 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:48.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:48.219 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:48.220 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:48.276 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:48.277 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:48.277 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:48.277 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:49.212 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:49.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:49.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:49.311 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:49.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:49.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:49.363 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:49.372 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:49.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:49.382 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:49.382 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:49.438 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:49.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:49.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:49.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:49.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:49.464 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:49.464 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:49.522 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:49.523 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:49.523 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:49.523 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:50.440 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:50.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:50.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:50.538 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:50.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:50.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:50.590 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:50.599 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:50.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:50.607 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:50.607 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:50.664 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:50.664 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:50.664 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:50.664 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:50.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:50.673 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:50.673 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:50.730 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:50.730 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:50.730 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:50.730 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:51.665 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:51.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:51.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:51.763 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:51.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:51.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:51.816 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:51.825 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:51.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:51.833 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:51.833 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:51.890 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:51.890 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:51.890 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:51.890 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:51.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:51.897 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:51.898 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:51.954 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:51.955 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:51.955 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:51.955 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:52.891 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:52.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:52.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:52.989 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:52.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:52.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:53.042 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:53.051 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:53.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:53.060 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:53.060 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:53.116 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:53.116 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:53.116 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:53.117 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:53.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:53.133 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:53.133 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:53.189 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:53.190 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:53.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:53.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:54.117 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:54.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:54.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:54.217 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:54.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:54.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:54.226 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:54.279 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:54.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:54.307 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:54.308 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:54.364 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:54.365 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:54.365 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:54.365 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:54.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:54.369 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:54.369 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:54.426 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:54.426 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:54.427 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:54.427 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:55.366 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:55.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:55.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:55.424 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:55.428 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:55.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:55.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:55.489 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:55.498 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:55.498 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:55.498 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:55.555 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:55.555 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:55.555 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:55.555 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:55.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:55.578 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:55.578 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:55.635 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:55.635 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:55.635 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:55.636 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:56.556 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:56.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:56.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:56.655 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:56.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:56.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:56.708 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:56.717 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:56.725 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:56.725 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:56.725 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:56.781 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:56.782 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:56.782 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:56.782 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:56.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:56.793 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:56.793 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:56.850 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:56.851 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:56.851 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:56.851 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:57.782 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:57.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:57.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:57.881 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:57.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:57.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:57.933 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:57.943 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:57.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:57.951 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:57.951 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:58.008 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:58.008 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:58.008 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:58.008 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:58.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:58.017 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:58.017 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:58.075 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:58.075 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:58.075 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:58.075 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:59.009 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:31:59.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:59.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:59.109 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:31:59.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:59.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:59.162 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:31:59.171 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:31:59.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:31:59.180 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:59.180 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:31:59.237 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:59.237 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:59.237 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:59.237 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:59.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:31:59.246 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:59.247 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:31:59.304 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:59.304 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:59.304 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:59.304 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:00.239 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:00.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:00.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:00.336 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:00.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:00.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:00.389 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:00.398 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:00.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:00.406 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:00.406 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:00.462 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:00.462 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:00.463 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:00.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:00.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:00.474 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:00.474 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:00.531 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:00.531 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:00.531 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:00.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:01.463 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:01.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:01.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:01.561 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:01.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:01.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:01.613 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:01.622 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:01.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:01.630 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:01.630 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:01.688 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:01.688 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:01.688 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:01.688 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:01.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:01.697 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:01.697 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:01.755 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:01.755 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:01.755 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:01.755 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:02.689 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:02.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:02.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:02.789 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:02.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:02.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:02.842 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:02.851 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:02.859 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:02.859 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:02.860 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:02.917 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:02.917 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:02.917 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:02.917 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:02.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:02.927 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:02.927 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:02.985 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:02.986 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:02.986 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:02.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:03.918 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:03.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:03.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:04.016 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:04.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:04.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:04.069 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:04.078 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:04.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:04.086 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:04.086 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:04.142 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:04.142 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:04.142 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:04.142 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:04.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:04.153 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:04.153 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:04.209 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:04.210 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:04.210 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:04.210 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:05.143 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:05.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:05.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:05.242 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:05.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:05.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:05.295 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:05.305 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:05.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:05.313 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:05.313 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:05.370 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:05.370 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:05.370 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:05.370 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:05.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:05.386 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:05.386 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:05.443 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:05.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:05.444 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:05.444 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:06.371 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:06.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:06.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:06.472 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:06.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:06.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:06.482 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:06.534 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:06.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:06.552 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:06.553 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:06.609 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:06.609 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:06.609 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:06.609 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:06.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:06.610 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:06.610 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:06.668 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:06.668 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:06.668 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:06.668 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:07.610 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:07.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:07.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:07.709 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:07.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:07.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:07.762 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:07.771 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:07.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:07.779 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:07.779 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:07.837 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:07.837 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:07.837 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:07.838 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:07.848 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:07.849 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:07.849 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:07.906 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:07.906 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:07.906 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:07.906 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:08.839 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:08.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:08.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:08.935 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:08.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:08.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:08.988 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:08.998 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:09.005 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:09.005 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:09.005 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:09.062 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:09.062 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:09.062 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:09.062 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:09.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:09.087 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:09.087 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:09.145 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:09.145 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:09.145 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:09.146 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:10.063 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:10.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:10.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:10.161 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:10.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:10.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:10.213 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:10.223 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:10.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:10.230 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:10.230 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:10.287 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:10.287 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:10.287 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:10.287 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:10.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:10.309 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:10.310 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:10.367 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:10.367 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:10.368 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:10.368 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:11.288 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:11.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:11.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:11.387 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:11.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:11.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:11.397 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:11.449 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:11.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:11.470 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:11.471 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:11.528 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:11.528 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:11.528 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:11.528 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:11.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:11.536 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:11.536 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:11.592 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:11.593 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:11.593 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:11.593 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:12.529 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:12.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:12.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:12.629 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:12.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:12.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:12.681 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:12.691 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:12.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:12.698 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:12.698 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:12.756 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:12.756 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:12.756 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:12.757 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:12.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:12.767 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:12.767 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:12.825 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:12.825 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:12.825 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:12.825 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:13.758 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:13.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:13.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:13.856 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:13.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:13.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:13.909 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:13.919 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:13.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:13.927 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:13.927 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:13.983 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:13.983 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:13.984 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:13.984 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:13.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:13.998 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:13.998 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:14.055 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:14.055 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:14.055 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:14.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:14.985 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:14.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:14.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:15.083 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:15.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:15.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:15.135 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:15.145 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:15.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:15.154 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:15.154 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:15.210 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:15.211 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:15.211 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:15.211 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:15.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:15.228 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:15.228 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:15.285 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:15.285 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:15.285 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:15.285 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:16.212 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:16.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:16.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:16.312 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:16.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:16.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:16.365 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:16.375 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:16.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:16.382 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:16.383 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:16.439 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:16.440 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:16.440 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:16.440 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:16.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:16.448 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:16.448 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:16.505 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:16.505 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:16.505 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:16.505 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:17.440 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:17.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:17.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:17.541 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:17.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:17.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:17.592 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:17.602 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:17.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:17.610 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:17.610 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:17.666 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:17.666 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:17.666 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:17.666 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:17.687 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:17.687 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:17.687 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:17.744 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:17.745 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:17.745 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:17.745 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:18.668 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:18.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:18.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:18.766 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:18.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:18.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:18.819 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:18.828 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:18.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:18.837 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:18.837 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:18.893 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:18.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:18.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:18.894 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:18.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:18.902 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:18.902 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:18.959 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:18.959 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:18.959 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:18.959 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:19.894 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:19.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:19.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:19.994 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:19.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:19.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:20.046 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:20.056 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:20.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:20.064 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:20.064 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:20.120 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:20.120 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:20.120 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:20.120 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:20.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:20.145 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:20.146 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:20.203 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:20.203 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:20.203 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:20.203 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:21.121 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:21.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:21.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:21.221 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:21.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:21.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:21.274 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:21.283 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:21.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:21.291 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:21.291 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:21.348 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:21.348 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:21.348 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:21.348 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:21.371 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:21.371 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:21.371 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:21.429 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:21.429 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:21.429 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:21.429 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:22.349 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:22.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:22.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:22.448 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:22.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:22.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:22.500 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:22.509 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:22.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:22.518 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:22.518 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:22.574 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:22.575 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:22.575 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:22.575 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:22.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:22.599 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:22.599 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:22.655 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:22.656 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:22.656 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:22.656 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:23.576 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:23.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:23.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:23.675 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:23.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:23.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:23.728 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:23.737 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:23.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:23.745 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:23.745 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:23.802 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:23.802 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:23.802 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:23.802 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:23.811 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:23.811 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:23.811 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:23.870 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:23.870 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:23.870 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:23.870 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:24.803 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:24.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:24.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:24.904 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:24.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:24.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:24.957 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:24.967 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:24.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:24.974 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:24.974 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:25.031 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:25.031 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:25.031 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:25.031 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:25.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:25.054 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:25.054 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:25.112 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:25.112 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:25.113 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:25.113 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:26.032 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:26.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:26.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:26.132 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:26.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:26.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:26.184 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:26.194 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:26.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:26.202 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:26.202 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:26.258 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:26.259 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:26.259 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:26.259 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:26.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:26.279 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:26.279 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:26.336 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:26.336 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:26.336 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:26.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:27.260 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:27.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:27.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:27.359 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:27.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:27.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:27.411 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:27.420 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:27.429 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:27.429 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:27.429 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:27.485 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:27.485 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:27.485 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:27.485 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:27.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:27.501 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:27.501 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:27.558 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:27.558 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:27.558 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:27.558 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:28.486 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:28.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:28.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:28.586 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:28.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:28.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:28.639 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:28.648 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:28.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:28.656 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:28.656 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:28.712 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:28.712 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:28.712 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:28.712 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:28.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:28.720 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:28.720 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:28.777 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:28.778 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:28.778 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:28.778 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:29.713 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:29.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:29.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:29.810 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:29.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:29.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:29.862 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:29.872 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:29.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:29.880 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:29.880 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:29.936 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:29.936 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:29.936 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:29.936 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:29.957 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:29.957 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:29.958 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:30.014 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:30.015 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:30.015 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:30.015 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:30.937 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:30.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:30.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:31.035 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:31.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:31.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:31.087 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:31.096 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:31.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:31.105 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:31.105 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:31.163 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:31.163 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:31.163 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:31.163 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:31.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:31.182 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:31.182 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:31.239 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:31.239 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:31.239 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:31.239 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:32.164 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:32.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:32.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:32.263 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:32.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:32.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:32.315 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:32.324 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:32.332 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:32.333 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:32.333 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:32.389 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:32.390 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:32.390 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:32.390 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:32.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:32.409 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:32.409 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:32.466 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:32.467 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:32.467 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:32.467 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:33.391 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:33.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:33.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:33.491 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:33.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:33.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:33.543 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:33.552 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:33.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:33.561 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:33.561 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:33.617 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:33.617 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:33.618 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:33.618 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:33.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:33.640 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:33.640 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:33.697 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:33.698 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:33.698 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:33.698 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:34.619 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:34.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:34.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:34.718 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:34.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:34.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:34.770 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:34.779 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:34.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:34.787 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:34.787 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:34.843 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:34.843 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:34.843 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:34.843 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:34.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:34.852 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:34.853 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:34.909 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:34.910 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:34.910 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:34.910 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:35.844 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:35.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:35.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:35.943 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:35.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:35.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:35.953 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:36.005 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:36.035 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:36.035 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:36.035 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:36.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:36.078 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:36.078 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:36.094 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:36.094 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:36.094 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:36.094 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:36.135 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:36.135 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:36.135 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:36.135 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:37.095 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:37.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:37.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:37.194 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:37.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:37.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:37.246 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:37.255 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:37.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:37.263 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:37.263 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:37.321 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:37.321 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:37.321 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:37.321 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:37.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:37.328 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:37.328 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:37.386 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:37.386 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:37.386 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:37.386 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:38.322 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:38.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:38.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:38.420 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:38.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:38.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:38.473 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:38.482 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:38.490 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:38.490 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:38.490 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:38.548 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:38.548 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:38.548 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:38.548 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:38.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:38.558 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:38.558 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:38.615 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:38.615 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:38.616 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:38.616 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:39.548 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:39.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:39.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:39.647 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:39.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:39.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:39.700 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:39.709 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:39.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:39.717 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:39.718 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:39.774 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:39.774 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:39.775 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:39.775 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:39.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:39.788 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:39.788 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:39.846 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:39.846 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:39.846 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:39.846 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:40.776 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:40.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:40.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:40.874 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:40.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:40.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:40.926 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:40.936 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:40.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:40.944 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:40.944 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:41.001 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:41.001 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:41.001 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:41.001 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:41.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:41.014 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:41.014 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:41.070 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:41.071 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:41.071 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:41.071 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:42.002 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:42.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:42.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:42.100 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:42.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:42.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:42.153 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:42.162 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:42.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:42.171 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:42.171 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:42.228 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:42.229 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:42.229 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:42.229 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:42.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:42.252 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:42.253 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:42.309 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:42.310 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:42.310 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:42.310 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:43.229 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:43.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:43.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:43.327 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:43.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:43.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:43.380 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:43.389 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:43.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:43.397 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:43.397 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:43.453 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:43.453 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:43.453 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:43.453 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:43.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:43.470 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:43.470 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:43.527 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:43.527 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:43.527 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:43.527 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:44.454 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:44.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:44.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:44.552 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:44.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:44.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:44.605 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:44.614 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:44.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:44.622 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:44.622 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:44.679 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:44.679 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:44.679 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:44.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:44.696 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:44.696 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:44.696 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:44.752 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:44.753 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:44.753 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:44.753 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:45.680 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:45.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:45.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:45.785 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:45.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:45.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:45.838 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:45.847 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:45.855 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:45.855 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:45.855 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:45.911 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:45.911 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:45.911 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:45.911 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:45.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:45.925 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:45.925 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:45.982 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:45.982 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:45.982 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:45.983 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:46.911 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:46.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:46.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:47.011 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:47.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:47.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:47.063 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:47.072 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:47.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:47.080 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:47.080 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:47.137 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:47.137 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:47.137 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:47.138 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:47.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:47.157 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:47.157 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:47.215 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:47.215 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:47.215 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:47.215 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:48.138 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:48.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:48.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:48.238 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:48.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:48.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:48.290 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:48.299 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:48.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:48.307 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:48.307 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:48.364 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:48.364 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:48.364 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:48.364 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:48.375 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:48.375 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:48.375 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:48.432 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:48.433 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:48.433 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:48.433 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:49.365 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:49.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:49.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:49.465 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:49.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:49.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:49.518 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:49.527 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:49.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:49.535 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:49.535 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:49.592 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:49.592 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:49.592 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:49.593 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:49.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:49.608 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:49.608 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:49.665 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:49.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:49.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:49.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:50.594 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:50.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:50.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:50.695 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:50.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:50.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:50.747 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:50.757 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:50.765 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:50.765 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:50.765 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:50.822 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:50.823 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:50.823 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:50.823 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:50.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:50.832 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:50.832 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:50.888 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:50.889 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:50.889 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:50.889 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:51.824 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:51.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:51.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:51.922 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:51.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:51.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:51.974 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:51.984 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:51.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:51.992 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:51.992 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:52.049 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:52.049 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:52.049 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:52.049 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:52.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:52.067 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:52.067 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:52.125 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:52.125 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:52.125 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:52.125 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:53.050 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:53.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:53.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:53.138 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:53.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:53.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:53.190 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:53.200 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:53.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:53.209 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:53.209 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:53.266 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:53.266 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:53.266 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:53.266 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:53.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:53.275 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:53.275 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:53.334 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:53.334 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:53.334 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:53.334 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:54.267 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:54.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:54.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:54.340 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:54.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:54.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:54.392 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:54.402 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:54.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:54.410 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:54.410 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:54.467 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:54.468 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:54.468 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:54.468 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:54.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:54.483 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:54.483 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:54.540 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:54.540 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:54.540 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:54.540 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:55.469 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:55.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:55.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:55.568 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:55.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:55.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:55.620 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:55.629 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:55.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:55.637 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:55.637 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:55.694 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:55.694 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:55.694 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:55.694 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:55.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:55.718 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:55.718 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:55.774 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:55.774 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:55.774 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:55.775 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:56.695 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:56.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:56.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:56.773 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:56.775 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:56.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:56.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:56.840 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:56.848 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:56.848 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:56.849 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:56.905 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:56.905 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:56.905 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:56.905 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:56.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:56.925 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:56.925 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:56.982 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:56.982 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:56.982 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:56.982 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:57.907 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:57.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:57.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:58.007 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:58.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:58.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:58.059 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:58.068 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:58.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:58.077 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:58.077 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:58.133 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:58.133 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:58.133 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:58.133 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:58.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:58.156 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:58.156 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:58.214 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:58.215 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:58.215 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:58.215 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:59.134 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:32:59.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:59.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:59.234 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:32:59.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:59.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:59.286 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:32:59.295 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:32:59.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:32:59.304 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:59.304 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:32:59.360 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:59.360 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:59.360 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:59.360 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:59.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:32:59.382 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:59.382 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:32:59.439 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:59.440 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:59.440 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:59.440 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:00.361 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:00.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:00.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:00.459 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:00.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:00.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:00.510 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:00.520 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:00.528 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:00.528 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:00.528 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:00.585 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:00.586 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:00.586 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:00.586 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:00.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:00.605 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:00.605 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:00.664 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:00.664 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:00.664 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:00.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:01.587 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:01.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:01.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:01.685 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:01.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:01.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:01.738 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:01.747 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:01.755 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:01.755 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:01.755 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:01.813 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:01.813 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:01.813 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:01.813 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:01.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:01.824 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:01.824 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:01.880 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:01.881 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:01.881 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:01.881 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:02.814 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:02.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:02.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:02.911 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:02.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:02.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:02.964 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:02.973 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:02.981 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:02.981 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:02.981 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:03.038 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:03.038 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:03.038 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:03.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:03.047 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:03.047 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:03.047 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:03.105 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:03.105 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:03.105 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:03.105 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:04.039 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:04.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:04.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:04.104 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:04.106 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:04.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:04.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:04.169 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:04.188 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:04.188 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:04.188 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:04.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:04.238 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:04.238 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:04.245 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:04.245 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:04.245 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:04.245 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:04.295 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:04.296 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:04.296 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:04.296 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:05.245 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:05.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:05.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:05.343 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:05.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:05.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:05.395 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:05.405 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:05.414 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:05.414 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:05.414 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:05.472 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:05.472 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:05.472 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:05.472 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:05.490 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:05.490 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:05.490 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:05.547 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:05.548 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:05.548 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:05.548 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:06.473 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:06.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:06.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:06.572 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:06.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:06.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:06.623 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:06.632 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:06.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:06.641 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:06.641 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:06.697 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:06.697 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:06.697 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:06.697 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:06.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:06.716 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:06.716 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:06.775 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:06.776 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:06.776 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:06.776 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:07.698 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:07.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:07.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:07.795 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:07.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:07.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:07.805 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:07.859 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:07.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:07.880 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:07.880 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:07.937 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:07.937 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:07.937 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:07.938 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:07.942 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:07.942 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:07.942 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:07.999 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:07.999 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:07.999 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:07.999 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:08.938 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:08.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:08.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:09.033 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:09.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:09.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:09.085 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:09.095 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:09.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:09.103 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:09.103 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:09.159 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:09.160 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:09.160 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:09.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:09.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:09.175 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:09.175 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:09.232 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:09.233 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:09.233 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:09.233 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:10.161 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:10.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:10.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:10.260 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:10.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:10.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:10.313 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:10.322 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:10.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:10.331 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:10.331 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:10.389 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:10.389 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:10.389 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:10.389 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:10.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:10.404 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:10.404 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:10.461 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:10.462 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:10.462 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:10.462 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:11.390 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:11.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:11.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:11.489 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:11.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:11.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:11.541 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:11.551 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:11.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:11.559 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:11.559 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:11.617 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:11.617 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:11.617 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:11.617 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:11.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:11.630 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:11.630 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:11.688 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:11.688 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:11.688 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:11.688 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:12.619 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:12.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:12.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:12.696 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:12.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:12.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:12.749 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:12.759 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:12.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:12.767 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:12.767 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:12.824 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:12.824 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:12.824 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:12.824 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:12.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:12.835 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:12.835 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:12.892 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:12.892 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:12.892 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:12.892 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:13.825 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:13.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:13.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:13.923 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:13.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:13.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:13.976 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:13.985 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:13.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:13.994 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:13.994 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:14.050 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:14.050 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:14.051 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:14.051 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:14.057 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:14.057 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:14.057 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:14.115 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:14.115 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:14.115 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:14.115 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:15.051 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:15.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:15.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:15.112 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:15.116 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:15.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:15.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:15.177 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:15.187 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:15.187 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:15.187 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:15.244 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:15.244 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:15.244 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:15.244 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:15.251 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:15.251 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:15.251 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:15.308 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:15.308 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:15.308 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:15.308 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:16.245 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:16.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:16.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:16.316 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:16.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:16.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:16.370 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:16.379 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:16.388 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:16.388 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:16.388 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:16.445 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:16.445 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:16.445 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:16.445 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:16.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:16.454 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:16.455 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:16.511 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:16.512 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:16.512 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:16.512 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:17.446 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:17.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:17.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:17.548 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:17.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:17.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:17.599 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:17.609 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:17.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:17.617 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:17.617 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:17.673 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:17.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:17.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:17.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:17.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:17.694 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:17.694 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:17.750 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:17.751 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:17.751 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:17.751 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:18.674 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:18.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:18.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:18.775 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:18.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:18.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:18.828 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:18.837 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:18.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:18.845 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:18.845 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:18.903 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:18.903 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:18.903 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:18.903 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:18.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:18.919 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:18.919 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:18.975 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:18.976 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:18.976 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:18.976 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:19.904 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:19.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:19.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:20.018 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:20.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:20.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:20.029 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:20.091 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:20.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:20.107 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:20.107 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:20.165 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:20.166 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:20.166 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:20.166 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:20.173 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:20.173 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:20.173 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:20.230 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:20.230 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:20.230 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:20.230 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:21.167 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:21.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:21.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:21.267 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:21.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:21.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:21.320 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:21.329 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:21.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:21.338 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:21.338 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:21.395 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:21.395 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:21.396 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:21.396 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:21.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:21.412 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:21.412 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:21.468 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:21.469 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:21.469 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:21.469 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:22.397 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:22.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:22.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:22.485 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:22.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:22.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:22.545 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:22.554 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:22.562 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:22.562 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:22.562 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:22.620 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:22.620 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:22.620 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:22.620 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:22.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:22.632 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:22.632 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:22.690 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:22.691 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:22.691 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:22.691 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:23.621 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:23.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:23.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:23.722 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:23.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:23.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:23.775 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:23.785 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:23.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:23.793 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:23.793 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:23.850 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:23.850 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:23.850 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:23.850 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:23.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:23.860 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:23.861 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:23.918 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:23.918 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:23.919 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:23.919 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:24.851 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:24.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:24.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:24.950 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:24.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:24.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:25.002 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:25.011 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:25.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:25.019 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:25.019 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:25.075 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:25.075 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:25.076 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:25.076 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:25.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:25.087 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:25.087 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:25.145 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:25.146 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:25.146 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:25.146 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:26.076 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:26.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:26.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:26.173 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:26.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:26.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:26.226 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:26.235 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:26.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:26.243 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:26.243 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:26.300 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:26.300 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:26.300 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:26.300 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:26.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:26.319 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:26.319 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:26.377 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:26.377 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:26.377 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:26.378 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:27.301 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:27.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:27.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:27.407 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:27.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:27.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:27.478 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:27.487 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:27.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:27.496 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:27.496 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:27.553 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:27.553 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:27.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:27.553 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:27.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:27.568 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:27.569 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:27.625 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:27.626 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:27.626 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:27.626 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:28.554 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:28.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:28.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:28.666 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:28.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:28.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:28.719 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:28.728 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:28.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:28.736 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:28.736 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:28.793 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:28.793 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:28.793 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:28.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:28.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:28.806 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:28.806 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:28.863 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:28.863 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:28.863 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:28.864 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:29.794 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:29.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:29.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:29.893 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:29.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:29.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:29.945 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:29.955 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:29.965 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:29.965 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:29.965 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:30.022 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:30.022 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:30.022 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:30.022 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:30.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:30.046 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:30.046 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:30.103 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:30.103 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:30.103 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:30.103 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:31.023 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:31.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:31.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:31.122 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:31.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:31.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:31.174 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:31.183 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:31.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:31.192 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:31.192 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:31.249 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:31.249 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:31.249 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:31.249 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:31.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:31.270 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:31.270 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:31.327 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:31.328 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:31.328 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:31.328 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:32.250 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:32.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:32.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:32.347 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:32.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:32.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:32.398 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:32.407 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:32.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:32.416 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:32.416 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:32.472 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:32.472 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:32.473 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:32.473 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:32.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:32.478 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:32.478 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:32.535 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:32.536 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:32.536 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:32.536 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:33.474 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:33.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:33.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:33.572 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:33.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:33.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:33.625 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:33.634 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:33.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:33.643 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:33.643 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:33.700 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:33.700 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:33.700 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:33.700 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:33.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:33.718 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:33.718 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:33.775 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:33.776 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:33.776 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:33.776 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:34.700 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:34.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:34.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:34.799 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:34.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:34.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:34.851 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:34.860 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:34.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:34.869 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:34.869 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:34.925 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:34.925 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:34.925 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:34.926 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:34.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:34.934 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:34.934 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:34.992 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:34.992 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:34.992 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:34.992 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:35.926 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:35.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:35.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:36.025 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:36.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:36.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:36.078 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:36.088 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:36.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:36.097 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:36.098 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:36.155 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:36.155 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:36.155 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:36.155 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:36.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:36.163 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:36.163 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:36.222 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:36.222 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:36.222 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:36.222 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:37.157 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:37.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:37.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:37.256 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:37.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:37.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:37.336 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:37.345 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:37.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:37.355 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:37.355 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:37.412 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:37.412 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:37.412 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:37.412 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:37.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:37.427 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:37.427 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:37.484 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:37.484 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:37.484 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:37.484 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:38.413 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:38.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:38.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:38.510 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:38.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:38.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:38.563 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:38.572 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:38.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:38.580 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:38.580 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:38.637 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:38.637 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:38.637 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:38.637 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:38.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:38.652 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:38.652 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:38.709 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:38.710 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:38.710 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:38.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:39.638 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:39.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:39.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:39.737 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:39.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:39.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:39.789 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:39.798 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:39.807 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:39.807 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:39.807 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:39.864 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:39.864 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:39.864 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:39.864 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:39.879 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:39.879 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:39.879 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:39.936 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:39.937 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:39.937 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:39.937 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:40.865 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:40.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:40.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:40.963 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:40.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:40.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:41.015 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:41.024 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:41.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:41.032 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:41.032 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:41.089 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:41.089 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:41.089 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:41.089 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:41.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:41.108 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:41.108 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:41.164 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:41.165 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:41.165 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:41.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:42.090 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:42.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:42.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:42.189 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:42.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:42.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:42.245 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:42.255 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:42.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:42.263 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:42.263 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:42.320 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:42.320 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:42.320 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:42.320 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:42.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:42.341 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:42.341 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:42.398 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:42.399 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:42.399 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:42.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:43.321 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:43.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:43.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:43.419 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:43.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:43.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:43.470 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:43.480 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:43.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:43.488 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:43.488 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:43.545 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:43.545 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:43.545 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:43.545 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:43.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:43.557 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:43.557 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:43.614 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:43.614 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:43.614 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:43.614 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:44.546 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:44.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:44.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:44.644 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:44.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:44.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:44.696 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:44.706 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:44.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:44.714 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:44.714 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:44.770 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:44.770 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:44.771 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:44.771 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:44.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:44.789 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:44.789 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:44.847 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:44.847 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:44.847 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:44.847 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:45.771 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:45.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:45.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:45.869 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:45.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:45.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:45.921 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:45.930 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:45.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:45.938 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:45.938 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:45.995 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:45.995 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:45.995 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:45.995 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:46.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:46.004 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:46.004 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:46.061 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:46.062 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:46.062 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:46.062 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:46.996 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:46.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:46.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:47.095 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:47.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:47.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:47.147 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:47.156 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:47.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:47.164 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:47.164 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:47.221 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:47.221 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:47.221 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:47.221 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:47.235 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:47.235 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:47.235 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:47.292 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:47.293 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:47.293 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:47.293 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:48.222 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:48.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:48.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:48.320 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:48.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:48.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:48.373 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:48.382 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:48.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:48.391 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:48.391 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:48.448 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:48.448 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:48.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:48.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:48.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:48.457 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:48.457 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:48.515 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:48.515 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:48.515 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:48.515 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:49.449 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:49.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:49.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:49.547 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:49.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:49.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:49.600 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:49.609 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:49.617 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:49.617 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:49.617 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:49.674 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:49.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:49.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:49.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:49.687 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:49.687 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:49.688 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:49.744 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:49.745 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:49.745 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:49.745 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:50.675 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:50.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:50.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:50.773 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:50.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:50.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:50.826 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:50.836 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:50.843 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:50.844 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:50.844 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:50.900 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:50.900 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:50.900 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:50.900 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:50.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:50.910 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:50.910 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:50.967 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:50.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:50.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:50.968 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:51.902 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:51.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:51.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:52.000 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:52.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:52.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:52.052 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:52.061 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:52.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:52.069 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:52.069 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:52.126 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:52.126 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:52.126 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:52.126 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:52.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:52.149 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:52.149 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:52.207 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:52.207 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:52.207 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:52.207 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:53.127 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:53.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:53.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:53.225 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:53.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:53.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:53.277 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:53.286 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:53.294 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:53.294 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:53.294 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:53.353 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:53.353 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:53.353 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:53.353 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:53.373 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:53.373 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:53.373 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:53.430 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:53.431 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:53.431 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:53.431 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:54.354 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:54.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:54.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:54.452 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:54.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:54.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:54.504 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:54.513 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:54.522 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:54.522 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:54.522 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:54.578 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:54.578 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:54.579 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:54.579 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:54.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:54.586 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:54.587 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:54.643 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:54.644 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:54.644 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:54.644 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:55.580 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:55.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:55.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:55.678 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:55.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:55.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:55.730 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:55.739 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:55.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:55.748 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:55.748 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:55.805 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:55.805 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:55.805 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:55.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:55.819 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:55.819 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:55.819 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:55.877 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:55.878 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:55.878 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:55.878 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:56.805 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:56.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:56.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:56.905 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:56.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:56.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:56.915 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:56.968 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:56.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:56.986 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:56.986 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:57.043 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:57.043 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:57.043 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:57.043 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:57.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:57.054 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:57.054 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:57.112 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:57.112 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:57.113 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:57.113 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:58.044 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:58.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:58.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:58.143 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:58.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:58.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:58.196 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:58.206 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:58.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:58.214 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:58.215 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:58.272 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:58.272 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:58.272 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:58.272 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:58.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:58.297 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:58.297 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:58.355 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:58.355 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:58.356 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:58.356 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:59.273 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:33:59.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:59.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:59.371 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:33:59.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:59.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:59.423 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:33:59.433 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:33:59.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:33:59.441 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:59.441 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:33:59.498 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:59.498 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:59.498 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:59.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:59.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:33:59.516 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:59.516 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:33:59.573 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:59.573 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:59.573 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:59.574 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:00.499 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:00.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:00.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:00.598 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:00.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:00.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:00.653 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:00.662 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:00.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:00.670 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:00.671 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:00.727 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:00.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:00.728 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:00.728 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:00.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:00.737 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:00.737 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:00.795 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:00.795 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:00.795 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:00.795 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:01.729 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:01.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:01.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:01.827 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:01.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:01.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:01.880 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:01.889 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:01.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:01.897 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:01.897 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:01.954 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:01.954 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:01.954 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:01.955 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:01.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:01.976 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:01.976 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:02.033 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:02.033 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:02.034 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:02.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:02.955 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:02.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:02.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:03.054 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:03.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:03.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:03.106 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:03.115 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:03.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:03.123 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:03.123 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:03.179 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:03.180 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:03.180 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:03.180 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:03.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:03.187 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:03.187 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:03.243 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:03.244 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:03.244 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:03.244 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:04.181 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:04.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:04.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:04.279 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:04.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:04.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:04.332 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:04.341 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:04.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:04.349 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:04.349 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:04.405 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:04.405 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:04.406 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:04.406 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:04.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:04.426 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:04.427 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:04.485 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:04.485 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:04.486 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:04.486 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:05.406 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:05.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:05.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:05.505 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:05.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:05.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:05.557 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:05.567 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:05.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:05.576 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:05.576 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:05.633 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:05.633 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:05.634 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:05.634 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:05.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:05.642 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:05.642 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:05.699 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:05.700 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:05.700 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:05.700 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:06.634 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:06.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:06.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:06.733 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:06.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:06.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:06.785 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:06.795 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:06.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:06.803 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:06.803 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:06.859 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:06.860 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:06.860 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:06.860 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:06.881 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:06.881 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:06.881 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:06.938 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:06.939 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:06.939 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:06.939 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:07.861 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:07.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:07.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:07.959 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:07.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:07.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:08.012 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:08.021 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:08.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:08.029 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:08.029 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:08.086 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:08.087 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:08.087 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:08.087 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:08.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:08.101 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:08.101 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:08.159 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:08.159 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:08.159 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:08.159 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:09.089 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:09.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:09.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:09.187 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:09.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:09.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:09.239 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:09.248 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:09.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:09.257 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:09.257 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:09.313 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:09.313 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:09.313 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:09.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:09.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:09.325 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:09.325 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:09.382 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:09.382 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:09.383 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:09.383 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:10.314 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:10.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:10.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:10.411 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:10.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:10.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:10.463 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:10.473 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:10.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:10.481 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:10.481 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:10.537 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:10.537 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:10.537 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:10.537 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:10.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:10.557 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:10.557 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:10.613 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:10.614 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:10.614 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:10.614 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:11.538 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:11.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:11.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:11.640 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:11.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:11.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:11.693 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:11.702 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:11.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:11.711 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:11.711 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:11.769 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:11.770 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:11.770 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:11.770 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:11.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:11.784 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:11.784 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:11.842 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:11.842 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:11.843 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:11.843 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:12.771 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:12.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:12.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:12.869 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:12.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:12.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:12.921 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:12.930 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:12.939 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:12.939 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:12.939 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:12.996 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:12.996 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:12.996 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:12.996 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:13.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:13.013 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:13.013 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:13.070 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:13.070 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:13.070 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:13.070 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:13.996 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:13.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:13.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:14.095 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:14.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:14.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:14.147 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:14.156 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:14.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:14.164 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:14.164 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:14.222 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:14.222 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:14.222 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:14.222 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:14.233 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:14.233 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:14.234 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:14.290 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:14.291 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:14.291 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:14.291 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:15.222 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:15.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:15.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:15.323 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:15.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:15.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:15.374 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:15.384 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:15.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:15.392 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:15.392 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:15.448 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:15.448 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:15.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:15.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:15.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:15.466 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:15.466 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:15.525 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:15.525 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:15.525 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:15.525 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:16.449 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:16.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:16.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:16.548 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:16.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:16.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:16.600 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:16.609 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:16.617 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:16.617 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:16.617 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:16.673 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:16.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:16.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:16.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:16.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:16.694 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:16.694 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:16.752 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:16.752 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:16.752 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:16.752 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:17.675 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:17.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:17.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:17.776 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:17.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:17.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:17.827 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:17.837 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:17.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:17.845 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:17.845 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:17.902 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:17.902 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:17.902 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:17.902 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:17.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:17.911 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:17.911 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:17.969 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:17.970 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:17.970 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:17.970 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:18.903 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:18.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:18.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:18.992 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:18.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:18.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:19.049 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:19.059 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:19.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:19.067 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:19.067 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:19.123 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:19.123 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:19.123 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:19.123 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:19.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:19.144 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:19.144 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:19.201 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:19.202 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:19.202 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:19.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:20.124 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:20.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:20.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:20.202 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:20.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:20.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:20.204 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:20.268 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:20.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:20.285 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:20.285 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:20.342 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:20.343 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:20.343 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:20.343 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:20.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:20.344 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:20.344 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:20.400 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:20.400 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:20.400 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:20.400 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:21.343 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:21.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:21.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:21.456 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:21.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:21.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:21.525 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:21.534 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:21.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:21.543 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:21.543 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:21.599 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:21.599 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:21.599 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:21.599 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:21.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:21.607 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:21.607 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:21.665 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:21.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:21.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:21.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:22.600 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:22.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:22.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:22.700 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:22.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:22.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:22.753 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:22.764 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:22.772 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:22.773 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:22.773 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:22.829 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:22.829 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:22.830 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:22.830 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:22.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:22.852 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:22.852 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:22.909 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:22.909 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:22.910 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:22.910 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:23.831 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:23.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:23.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:23.929 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:23.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:23.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:23.981 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:23.990 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:23.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:23.998 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:23.998 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:24.056 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:24.056 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:24.056 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:24.056 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:24.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:24.071 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:24.071 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:24.128 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:24.129 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:24.129 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:24.129 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:25.057 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:25.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:25.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:25.156 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:25.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:25.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:25.208 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:25.218 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:25.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:25.226 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:25.226 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:25.283 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:25.283 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:25.283 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:25.283 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:25.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:25.298 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:25.298 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:25.355 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:25.356 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:25.356 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:25.356 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:26.284 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:26.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:26.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:26.384 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:26.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:26.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:26.437 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:26.446 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:26.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:26.454 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:26.454 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:26.511 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:26.512 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:26.512 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:26.512 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:26.529 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:26.530 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:26.530 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:26.586 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:26.586 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:26.586 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:26.587 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:27.514 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:27.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:27.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:27.612 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:27.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:27.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:27.665 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:27.674 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:27.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:27.682 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:27.682 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:27.740 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:27.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:27.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:27.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:27.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:27.749 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:27.749 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:27.809 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:27.809 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:27.809 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:27.809 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:28.742 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:28.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:28.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:28.842 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:28.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:28.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:28.893 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:28.903 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:28.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:28.911 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:28.911 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:28.967 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:28.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:28.968 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:28.968 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:28.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:28.980 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:28.980 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:29.037 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:29.037 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:29.038 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:29.038 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:29.968 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:29.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:29.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:30.067 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:30.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:30.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:30.119 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:30.128 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:30.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:30.136 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:30.137 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:30.193 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:30.193 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:30.194 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:30.194 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:30.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:30.204 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:30.204 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:30.261 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:30.261 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:30.261 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:30.261 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:31.194 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:31.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:31.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:31.293 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:31.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:31.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:31.302 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:31.355 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:31.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:31.382 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:31.382 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:31.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:31.428 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:31.429 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:31.438 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:31.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:31.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:31.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:31.485 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:31.486 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:31.486 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:31.486 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:32.439 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:32.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:32.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:32.538 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:32.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:32.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:32.590 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:32.599 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:32.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:32.607 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:32.607 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:32.664 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:32.664 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:32.664 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:32.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:32.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:32.674 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:32.675 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:32.732 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:32.732 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:32.733 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:32.733 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:33.665 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:33.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:33.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:33.766 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:33.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:33.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:33.818 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:33.828 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:33.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:33.835 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:33.835 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:33.893 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:33.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:33.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:33.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:33.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:33.905 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:33.905 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:33.962 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:33.963 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:33.963 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:33.963 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:34.894 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:34.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:34.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:34.994 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:34.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:34.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:35.046 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:35.056 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:35.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:35.065 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:35.065 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:35.121 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:35.122 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:35.122 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:35.122 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:35.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:35.131 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:35.131 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:35.188 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:35.188 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:35.189 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:35.189 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:36.122 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:36.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:36.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:36.221 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:36.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:36.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:36.273 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:36.282 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:36.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:36.291 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:36.291 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:36.347 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:36.348 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:36.348 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:36.348 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:36.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:36.361 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:36.361 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:36.418 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:36.419 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:36.419 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:36.419 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:37.348 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:37.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:37.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:37.421 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:37.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:37.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:37.427 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:37.489 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:37.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:37.500 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:37.500 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:37.556 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:37.557 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:37.557 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:37.557 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:37.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:37.564 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:37.564 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:37.621 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:37.621 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:37.621 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:37.621 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:38.558 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:38.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:38.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:38.658 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:38.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:38.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:38.710 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:38.720 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:38.728 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:38.728 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:38.728 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:38.784 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:38.784 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:38.784 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:38.784 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:38.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:38.792 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:38.792 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:38.850 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:38.850 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:38.850 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:38.850 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:39.785 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:39.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:39.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:39.886 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:39.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:39.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:39.894 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:39.949 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:39.983 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:39.983 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:39.983 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:40.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:40.030 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:40.030 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:40.040 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:40.040 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:40.040 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:40.040 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:40.087 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:40.087 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:40.087 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:40.087 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:41.041 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:41.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:41.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:41.139 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:41.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:41.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:41.215 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:41.225 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:41.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:41.236 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:41.236 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:41.292 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:41.292 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:41.292 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:41.293 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:41.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:41.316 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:41.316 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:41.373 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:41.373 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:41.373 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:41.373 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:42.293 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:42.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:42.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:42.353 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:42.374 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:42.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:42.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:42.434 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:42.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:42.441 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:42.441 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:42.497 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:42.497 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:42.497 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:42.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:42.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:42.508 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:42.509 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:42.564 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:42.564 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:42.564 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:42.564 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:43.498 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:43.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:43.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:43.598 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:43.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:43.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:43.651 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:43.660 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:43.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:43.669 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:43.669 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:43.725 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:43.726 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:43.726 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:43.726 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:43.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:43.742 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:43.743 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:43.799 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:43.799 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:43.799 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:43.799 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:44.727 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:44.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:44.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:44.824 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:44.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:44.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:44.876 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:44.886 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:44.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:44.894 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:44.894 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:44.951 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:44.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:44.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:44.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:44.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:44.962 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:44.962 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:45.019 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:45.020 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:45.020 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:45.020 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:45.952 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:45.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:45.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:46.051 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:46.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:46.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:46.103 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:46.112 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:46.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:46.121 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:46.121 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:46.178 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:46.178 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:46.178 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:46.178 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:46.188 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:46.188 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:46.188 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:46.246 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:46.246 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:46.246 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:46.246 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:47.179 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:47.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:47.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:47.277 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:47.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:47.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:47.330 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:47.339 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:47.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:47.347 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:47.347 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:47.404 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:47.404 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:47.404 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:47.404 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:47.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:47.417 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:47.417 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:47.476 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:47.476 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:47.477 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:47.477 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:48.405 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:48.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:48.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:48.503 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:48.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:48.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:48.554 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:48.563 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:48.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:48.571 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:48.572 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:48.628 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:48.628 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:48.628 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:48.628 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:48.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:48.645 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:48.645 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:48.703 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:48.703 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:48.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:48.703 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:49.630 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:49.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:49.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:49.728 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:49.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:49.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:49.781 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:49.790 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:49.798 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:49.798 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:49.798 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:49.856 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:49.857 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:49.857 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:49.857 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:49.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:49.874 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:49.874 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:49.931 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:49.932 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:49.932 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:49.932 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:50.858 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:50.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:50.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:50.956 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:50.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:50.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:51.008 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:51.017 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:51.025 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:51.025 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:51.025 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:51.083 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:51.083 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:51.083 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:51.083 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:51.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:51.102 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:51.102 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:51.159 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:51.160 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:51.160 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:51.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:52.084 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:52.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:52.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:52.182 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:52.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:52.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:52.233 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:52.243 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:52.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:52.250 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:52.250 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:52.308 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:52.308 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:52.308 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:52.308 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:52.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:52.324 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:52.324 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:52.381 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:52.381 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:52.381 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:52.381 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:53.308 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:53.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:53.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:53.406 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:53.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:53.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:53.458 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:53.467 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:53.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:53.477 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:53.477 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:53.533 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:53.533 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:53.533 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:53.533 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:53.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:53.543 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:53.543 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:53.600 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:53.600 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:53.600 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:53.601 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:54.534 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:54.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:54.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:54.633 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:54.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:54.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:54.686 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:54.695 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:54.703 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:54.703 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:54.703 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:54.760 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:54.760 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:54.760 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:54.760 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:54.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:54.770 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:54.770 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:54.827 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:54.828 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:54.828 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:54.828 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:55.761 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:55.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:55.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:55.859 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:55.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:55.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:55.915 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:55.924 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:55.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:55.932 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:55.932 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:55.990 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:55.990 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:55.990 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:55.990 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:56.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:56.012 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:56.012 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:56.069 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:56.070 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:56.070 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:56.070 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:56.991 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:56.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:56.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:57.089 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:57.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:57.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:57.141 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:57.150 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:57.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:57.158 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:57.159 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:57.216 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:57.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:57.216 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:57.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:57.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:57.239 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:57.239 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:57.296 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:57.297 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:57.297 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:57.297 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:58.218 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:58.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:58.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:58.298 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:58.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:58.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:58.300 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:58.361 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:58.375 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:58.375 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:58.375 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:58.431 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:58.432 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:58.432 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:58.432 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:58.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:58.437 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:58.437 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:58.496 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:58.496 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:58.496 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:58.497 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:59.433 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:34:59.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:59.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:59.498 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:34:59.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:59.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:59.502 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:34:59.558 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:34:59.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:34:59.590 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:59.590 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:34:59.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:34:59.641 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:59.641 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:34:59.646 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:59.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:59.646 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:59.646 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:59.698 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:59.698 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:59.698 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:59.698 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:00.648 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:00.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:00.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:00.747 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:00.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:00.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:00.801 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:00.810 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:00.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:00.818 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:00.818 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:00.874 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:00.874 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:00.874 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:00.874 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:00.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:00.883 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:00.884 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:00.940 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:00.941 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:00.941 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:00.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:01.875 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:01.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:01.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:01.973 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:01.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:01.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:02.025 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:02.035 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:02.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:02.043 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:02.043 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:02.099 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:02.099 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:02.099 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:02.099 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:02.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:02.109 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:02.109 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:02.166 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:02.167 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:02.167 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:02.167 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:03.101 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:03.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:03.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:03.200 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:03.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:03.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:03.252 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:03.261 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:03.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:03.269 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:03.270 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:03.327 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:03.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:03.327 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:03.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:03.335 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:03.335 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:03.335 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:03.393 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:03.393 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:03.393 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:03.394 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:04.328 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:04.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:04.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:04.395 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:04.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:04.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:04.396 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:04.457 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:04.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:04.486 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:04.486 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:04.540 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:04.540 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:04.540 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:04.542 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:04.542 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:04.542 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:04.542 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:04.598 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:04.598 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:04.598 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:04.598 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:05.544 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:05.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:05.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:05.643 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:05.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:05.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:05.694 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:05.704 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:05.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:05.753 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:05.754 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:05.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:05.790 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:05.790 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:05.810 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:05.810 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:05.811 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:05.811 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:05.846 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:05.847 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:05.847 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:05.847 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:06.811 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:06.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:06.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:06.910 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:06.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:06.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:06.962 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:06.971 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:06.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:06.979 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:06.979 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:07.037 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:07.037 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:07.037 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:07.037 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:07.047 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:07.047 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:07.047 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:07.104 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:07.105 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:07.105 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:07.105 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:08.038 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:08.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:08.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:08.135 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:08.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:08.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:08.187 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:08.197 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:08.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:08.205 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:08.206 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:08.262 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:08.262 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:08.263 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:08.263 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:08.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:08.280 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:08.280 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:08.335 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:08.336 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:08.336 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:08.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:09.264 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:09.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:09.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:09.363 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:09.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:09.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:09.415 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:09.424 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:09.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:09.432 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:09.432 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:09.488 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:09.488 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:09.488 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:09.488 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:09.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:09.510 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:09.510 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:09.567 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:09.568 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:09.568 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:09.568 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:10.489 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:10.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:10.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:10.588 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:10.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:10.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:10.640 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:10.649 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:10.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:10.657 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:10.657 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:10.714 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:10.714 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:10.714 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:10.714 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:10.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:10.720 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:10.720 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:10.778 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:10.778 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:10.778 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:10.778 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:11.715 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:11.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:11.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:11.814 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:11.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:11.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:11.866 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:11.876 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:11.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:11.884 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:11.884 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:11.940 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:11.940 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:11.940 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:11.940 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:11.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:11.949 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:11.949 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:12.006 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:12.007 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:12.007 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:12.007 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:12.941 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:12.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:12.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:13.040 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:13.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:13.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:13.093 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:13.102 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:13.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:13.110 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:13.110 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:13.168 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:13.168 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:13.168 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:13.168 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:13.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:13.190 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:13.190 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:13.248 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:13.248 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:13.249 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:13.249 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:14.169 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:14.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:14.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:14.269 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:14.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:14.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:14.321 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:14.330 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:14.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:14.338 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:14.339 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:14.396 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:14.396 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:14.396 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:14.396 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:14.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:14.421 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:14.422 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:14.479 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:14.480 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:14.480 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:14.480 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:15.397 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:15.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:15.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:15.482 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:15.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:15.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:15.486 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:15.542 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:15.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:15.561 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:15.561 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:15.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:15.616 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:15.616 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:15.618 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:15.618 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:15.618 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:15.618 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:15.673 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:15.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:15.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:15.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:16.618 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:16.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:16.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:16.742 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:16.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:16.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:16.752 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:16.804 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:16.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:16.842 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:16.842 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:16.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:16.885 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:16.886 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:16.900 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:16.900 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:16.900 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:16.900 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:16.943 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:16.943 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:16.943 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:16.943 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:17.901 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:17.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:17.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:18.017 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:18.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:18.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:18.026 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:18.079 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:18.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:18.115 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:18.115 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:18.160 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:18.160 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:18.160 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:18.172 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:18.172 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:18.172 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:18.172 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:18.217 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:18.218 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:18.218 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:18.218 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:19.174 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:19.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:19.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:19.273 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:19.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:19.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:19.324 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:19.333 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:19.342 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:19.342 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:19.342 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:19.399 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:19.399 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:19.399 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:19.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:19.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:19.418 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:19.418 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:19.474 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:19.475 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:19.475 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:19.475 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:20.400 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:20.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:20.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:20.499 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:20.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:20.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:20.509 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:20.561 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:20.579 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:20.579 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:20.579 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:20.635 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:20.635 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:20.636 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:20.636 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:20.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:20.640 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:20.641 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:20.698 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:20.698 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:20.699 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:20.699 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:21.637 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:21.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:21.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:21.735 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:21.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:21.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:21.787 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:21.797 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:21.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:21.804 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:21.804 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:21.861 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:21.862 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:21.862 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:21.862 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:21.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:21.874 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:21.874 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:21.932 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:21.932 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:21.932 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:21.933 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:22.862 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:22.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:22.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:22.959 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:22.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:22.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:23.012 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:23.021 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:23.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:23.029 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:23.029 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:23.087 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:23.087 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:23.087 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:23.087 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:23.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:23.099 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:23.099 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:23.157 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:23.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:23.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:23.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:24.088 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:24.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:24.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:24.186 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:24.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:24.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:24.239 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:24.248 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:24.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:24.256 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:24.256 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:24.313 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:24.314 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:24.314 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:24.314 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:24.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:24.333 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:24.333 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:24.389 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:24.390 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:24.390 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:24.390 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:25.314 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:25.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:25.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:25.417 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:25.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:25.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:25.469 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:25.479 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:25.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:25.487 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:25.487 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:25.545 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:25.545 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:25.545 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:25.545 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:25.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:25.564 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:25.564 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:25.622 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:25.622 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:25.622 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:25.623 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:26.546 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:26.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:26.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:26.644 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:26.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:26.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:26.696 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:26.705 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:26.713 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:26.713 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:26.713 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:26.771 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:26.771 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:26.771 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:26.771 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:26.790 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:26.790 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:26.790 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:26.847 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:26.848 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:26.848 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:26.848 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:27.772 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:27.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:27.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:27.871 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:27.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:27.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:27.927 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:27.936 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:27.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:27.944 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:27.945 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:28.001 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:28.001 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:28.002 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:28.002 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:28.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:28.010 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:28.010 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:28.068 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:28.068 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:28.068 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:28.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:29.002 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:29.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:29.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:29.102 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:29.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:29.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:29.155 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:29.165 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:29.173 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:29.173 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:29.174 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:29.230 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:29.231 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:29.231 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:29.231 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:29.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:29.239 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:29.239 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:29.295 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:29.295 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:29.295 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:29.296 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:30.231 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:30.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:30.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:30.331 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:30.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:30.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:30.384 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:30.393 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:30.401 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:30.401 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:30.401 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:30.459 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:30.459 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:30.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:30.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:30.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:30.482 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:30.482 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:30.540 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:30.540 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:30.540 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:30.540 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:31.459 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:31.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:31.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:31.558 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:31.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:31.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:31.610 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:31.619 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:31.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:31.627 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:31.627 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:31.684 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:31.684 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:31.684 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:31.684 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:31.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:31.693 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:31.694 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:31.750 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:31.751 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:31.751 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:31.751 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:32.685 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:32.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:32.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:32.784 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:32.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:32.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:32.836 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:32.845 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:32.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:32.853 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:32.853 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:32.912 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:32.912 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:32.912 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:32.912 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:32.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:32.922 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:32.922 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:32.980 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:32.980 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:32.980 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:32.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:33.914 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:33.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:33.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:34.012 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:34.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:34.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:34.021 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:34.074 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:34.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:34.098 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:34.098 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:34.155 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:34.155 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:34.156 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:34.156 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:34.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:34.159 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:34.159 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:34.217 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:34.217 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:34.217 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:34.217 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:35.156 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:35.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:35.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:35.255 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:35.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:35.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:35.308 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:35.317 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:35.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:35.325 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:35.325 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:35.382 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:35.382 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:35.382 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:35.382 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:35.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:35.391 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:35.391 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:35.448 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:35.449 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:35.449 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:35.449 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:36.383 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:36.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:36.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:36.482 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:36.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:36.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:36.533 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:36.542 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:36.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:36.550 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:36.550 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:36.608 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:36.608 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:36.608 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:36.608 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:36.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:36.631 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:36.631 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:36.688 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:36.688 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:36.689 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:36.689 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:37.609 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:37.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:37.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:37.708 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:37.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:37.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:37.760 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:37.770 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:37.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:37.778 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:37.778 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:37.835 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:37.835 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:37.835 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:37.835 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:37.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:37.854 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:37.854 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:37.910 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:37.911 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:37.911 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:37.911 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:38.836 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:38.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:38.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:38.935 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:38.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:38.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:38.988 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:38.997 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:39.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:39.006 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:39.006 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:39.064 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:39.064 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:39.064 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:39.064 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:39.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:39.071 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:39.071 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:39.128 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:39.129 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:39.129 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:39.129 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:40.065 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:40.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:40.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:40.164 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:40.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:40.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:40.216 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:40.225 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:40.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:40.234 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:40.234 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:40.290 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:40.291 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:40.291 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:40.291 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:40.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:40.307 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:40.308 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:40.364 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:40.364 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:40.365 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:40.365 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:41.291 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:41.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:41.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:41.390 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:41.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:41.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:41.399 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:41.451 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:41.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:41.480 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:41.480 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:41.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:41.527 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:41.528 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:41.537 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:41.538 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:41.538 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:41.538 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:41.584 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:41.585 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:41.585 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:41.585 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:42.539 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:42.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:42.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:42.641 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:42.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:42.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:42.693 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:42.703 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:42.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:42.711 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:42.711 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:42.767 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:42.768 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:42.768 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:42.768 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:42.780 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:42.780 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:42.780 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:42.838 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:42.839 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:42.839 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:42.839 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:43.769 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:43.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:43.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:43.868 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:43.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:43.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:43.920 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:43.929 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:43.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:43.937 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:43.937 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:43.993 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:43.994 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:43.994 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:43.994 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:44.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:44.014 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:44.014 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:44.072 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:44.072 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:44.072 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:44.072 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:44.995 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:44.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:44.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:45.093 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:45.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:45.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:45.145 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:45.155 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:45.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:45.162 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:45.162 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:45.219 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:45.219 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:45.219 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:45.219 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:45.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:45.231 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:45.231 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:45.289 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:45.289 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:45.289 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:45.290 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:46.220 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:46.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:46.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:46.319 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:46.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:46.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:46.371 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:46.381 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:46.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:46.389 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:46.389 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:46.446 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:46.446 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:46.446 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:46.446 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:46.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:46.458 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:46.458 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:46.516 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:46.516 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:46.516 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:46.516 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:47.447 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:47.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:47.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:47.547 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:47.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:47.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:47.599 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:47.608 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:47.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:47.617 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:47.617 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:47.674 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:47.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:47.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:47.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:47.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:47.693 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:47.693 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:47.751 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:47.751 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:47.751 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:47.751 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:48.675 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:48.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:48.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:48.774 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:48.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:48.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:48.826 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:48.835 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:48.844 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:48.844 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:48.844 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:48.900 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:48.900 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:48.901 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:48.901 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:48.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:48.926 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:48.926 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:48.983 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:48.983 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:48.983 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:48.983 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:49.902 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:49.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:49.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:49.977 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:49.985 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:49.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:49.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:50.045 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:50.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:50.054 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:50.054 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:50.111 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:50.111 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:50.111 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:50.111 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:50.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:50.123 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:50.123 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:50.179 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:50.180 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:50.180 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:50.180 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:51.112 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:51.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:51.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:51.210 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:51.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:51.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:51.263 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:51.272 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:51.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:51.280 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:51.280 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:51.337 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:51.337 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:51.337 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:51.337 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:51.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:51.347 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:51.347 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:51.404 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:51.405 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:51.405 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:51.405 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:52.338 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:52.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:52.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:52.436 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:52.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:52.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:52.488 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:52.497 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:52.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:52.506 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:52.506 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:52.562 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:52.562 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:52.562 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:52.562 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:52.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:52.576 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:52.576 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:52.633 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:52.633 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:52.633 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:52.634 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:53.563 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:53.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:53.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:53.661 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:53.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:53.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:53.712 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:53.721 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:53.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:53.730 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:53.730 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:53.787 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:53.787 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:53.787 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:53.787 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:53.807 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:53.807 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:53.807 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:53.864 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:53.864 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:53.864 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:53.864 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:54.788 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:54.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:54.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:54.887 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:54.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:54.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:54.939 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:54.948 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:54.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:54.958 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:54.958 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:55.015 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:55.015 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:55.015 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:55.016 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:55.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:55.027 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:55.027 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:55.084 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:55.085 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:55.085 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:55.085 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:56.017 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:56.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:56.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:56.114 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:56.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:56.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:56.166 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:56.175 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:56.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:56.184 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:56.184 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:56.241 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:56.241 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:56.241 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:56.241 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:56.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:56.250 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:56.250 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:56.308 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:56.309 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:56.309 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:56.309 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:57.242 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:57.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:57.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:57.342 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:57.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:57.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:57.394 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:57.403 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:57.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:57.412 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:57.412 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:57.469 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:57.469 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:57.469 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:57.469 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:57.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:57.487 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:57.488 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:57.544 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:57.544 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:57.544 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:57.544 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:58.470 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:58.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:58.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:58.529 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:58.544 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:58.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:58.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:58.604 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:58.617 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:58.617 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:58.617 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:58.674 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:58.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:58.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:58.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:58.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:58.685 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:58.685 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:58.742 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:58.742 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:58.742 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:58.742 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:59.675 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:35:59.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:59.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:59.772 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:35:59.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:59.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:35:59.824 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:35:59.833 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:35:59.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:35:59.842 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:59.842 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:35:59.898 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:59.898 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:59.898 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:59.899 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:35:59.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:35:59.907 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:35:59.908 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:35:59.965 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:35:59.965 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:35:59.965 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:35:59.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:00.899 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:36:00.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:00.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:00.997 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:36:00.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:00.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:01.049 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:36:01.058 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:36:01.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:01.066 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:01.066 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:36:01.124 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:01.124 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:01.124 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:01.124 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:01.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:01.133 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:01.133 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:36:01.191 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:01.191 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:01.191 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:01.191 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:02.125 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:36:02.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:02.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:02.225 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:36:02.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:02.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:02.277 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:36:02.286 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:36:02.294 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:02.294 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:02.295 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:36:02.352 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:02.352 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:02.352 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:02.353 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:02.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:02.362 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:02.362 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:36:02.419 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:02.420 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:02.420 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:02.420 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:03.354 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:36:03.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:03.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:03.452 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:36:03.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:03.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:03.503 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:36:03.513 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:36:03.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:03.521 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:03.521 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:36:03.577 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:03.577 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:03.577 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:03.577 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:03.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:03.583 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:03.583 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:36:03.640 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:03.641 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:03.641 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:03.641 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:04.578 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:36:04.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:04.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:04.676 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:36:04.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:04.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:04.728 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:36:04.738 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:36:04.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:04.746 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:04.746 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:36:04.802 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:04.803 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:04.803 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:04.803 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:04.811 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:04.811 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:04.811 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:36:04.869 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:04.869 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:04.869 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:04.870 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:05.803 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:36:05.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:05.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:05.903 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:36:05.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:05.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:05.955 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:36:05.964 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:36:05.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:05.972 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:05.972 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:36:06.028 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:06.028 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:06.028 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:06.028 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:06.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:06.038 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:06.038 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:36:06.095 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:06.095 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:06.095 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:06.095 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:07.029 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:36:07.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:07.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:07.128 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:36:07.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:07.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:07.180 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:36:07.189 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:36:07.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:07.197 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:07.197 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:36:07.253 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:07.254 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:07.254 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:07.254 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:07.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:07.269 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:07.269 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:36:07.326 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:07.326 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:07.326 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:07.326 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:08.254 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:36:08.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:08.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:08.354 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:36:08.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:08.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:08.405 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:36:08.414 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:36:08.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:08.422 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:08.422 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:36:08.479 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:08.479 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:08.479 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:08.480 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:08.498 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:08.498 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:08.499 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:36:08.556 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:08.556 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:08.556 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:08.556 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:09.480 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:36:09.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:09.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:09.580 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:36:09.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:09.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:09.632 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:36:09.641 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:36:09.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:09.649 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:09.649 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:36:09.706 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:09.706 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:09.706 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:09.706 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:09.731 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:09.731 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:09.731 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:36:09.789 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:09.789 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:09.789 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:09.789 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:10.707 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:36:10.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:10.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:10.806 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:36:10.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:10.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:10.859 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:36:10.868 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:36:10.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:10.876 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:10.876 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:36:10.933 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:10.933 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:10.933 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:10.933 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:10.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:10.946 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:10.946 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:36:11.003 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:11.004 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:11.004 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:11.004 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:11.934 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:36:11.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:11.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:12.034 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:36:12.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:12.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:12.086 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:36:12.096 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:36:12.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:12.104 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:12.104 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:36:12.162 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:12.162 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:12.162 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:12.162 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:12.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:12.169 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:12.169 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:36:12.227 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:12.227 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:12.227 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:12.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:13.163 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:36:13.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:13.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:13.262 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:36:13.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:13.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:13.314 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:36:13.323 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:36:13.332 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:13.332 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:13.332 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:36:13.388 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:13.388 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:13.388 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:13.389 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:13.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:13.409 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:13.409 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:36:13.465 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:13.466 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:13.466 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:13.466 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:14.390 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:36:14.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:14.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:14.489 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:36:14.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:14.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:14.542 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:36:14.551 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:36:14.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:14.559 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:14.559 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:36:14.616 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:14.616 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:14.616 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:14.617 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:14.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:14.633 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:14.633 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:36:14.690 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:14.690 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:14.690 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:14.690 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:15.617 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:36:15.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:15.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:15.714 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:36:15.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:15.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:15.766 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:36:15.775 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:36:15.783 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:15.783 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:15.783 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:36:15.840 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:15.841 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:15.841 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:15.841 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:15.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:15.853 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:15.853 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:36:15.911 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:15.912 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:15.912 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:15.912 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:16.841 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:36:16.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:16.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:16.939 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:36:16.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:16.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:36:16.991 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:36:17.000 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:36:17.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:36:17.009 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:17.009 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:36:17.065 INFO:teuthology.orchestra.run.trial013.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:17.065 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:17.065 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:17.065 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:17.066 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:17.067 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:36:17.083 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:36:17.115 INFO:teuthology.run:Summary data: description: fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/pool-perm} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:36:17.115 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:36:17.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:36:17.120 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:36:17.121 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:36:17.209 INFO:teuthology.orchestra.run.trial123.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:36:17.209 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:36:17.209 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:36:17.209 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:36:17.229 INFO:teuthology.run:FAIL