2026-02-12T21:57:36.960 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T21:57:36.978 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T21:57:37.058 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47093 branch: wip-pdonnell-testing-20260210.171210 description: fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/workunit/quota} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47093' kernel: client: sha1: distro sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds use global snaprealm seq for subvol: false mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: syntax: v1 selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial020.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGHWB8CiVuNI/V+mL85CMKpseIjLml549uZZuXfpoa6nazwxNHdSNJV0nySmYDIe1mSrcj5n+DC1RhLSLeQ67p8= trial164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKqN57dD49wESIDPG/i9HRsEy5iLqGn3EqxiItgHitUzBplOXKZhsjiPjN1QynT/NZdeYmadPFzaH5I7a/dH8AA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - kclient: null - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - workunit: clients: all: - fs/quota teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T21:57:37.058 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T21:57:37.058 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T21:57:37.059 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T21:57:37.060 INFO:teuthology.task.internal:Checking packages... 2026-02-12T21:57:37.060 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T21:57:37.060 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T21:57:37.060 INFO:teuthology.packaging:ref: None 2026-02-12T21:57:37.060 INFO:teuthology.packaging:tag: None 2026-02-12T21:57:37.060 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T21:57:37.060 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T21:57:37.061 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T21:57:37.179 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T21:57:37.181 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T21:57:37.193 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T21:57:37.193 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T21:57:37.207 INFO:teuthology.task.internal:Saving configuration 2026-02-12T21:57:37.230 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T21:57:37.242 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T21:57:37.317 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial020.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47093', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 21:54:14.037621', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGHWB8CiVuNI/V+mL85CMKpseIjLml549uZZuXfpoa6nazwxNHdSNJV0nySmYDIe1mSrcj5n+DC1RhLSLeQ67p8='} 2026-02-12T21:57:37.370 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial164.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47093', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 21:54:14.038264', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKqN57dD49wESIDPG/i9HRsEy5iLqGn3EqxiItgHitUzBplOXKZhsjiPjN1QynT/NZdeYmadPFzaH5I7a/dH8AA='} 2026-02-12T21:57:37.370 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T21:57:37.382 INFO:teuthology.task.internal:roles: ubuntu@trial020.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2026-02-12T21:57:37.382 INFO:teuthology.task.internal:roles: ubuntu@trial164.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2026-02-12T21:57:37.382 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T21:57:37.512 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7827b33ee020>, signals=[15]) 2026-02-12T21:57:37.512 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T21:57:37.524 INFO:teuthology.task.internal:Opening connections... 2026-02-12T21:57:37.524 DEBUG:teuthology.task.internal:connecting to ubuntu@trial020.front.sepia.ceph.com 2026-02-12T21:57:37.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:57:37.585 DEBUG:teuthology.task.internal:connecting to ubuntu@trial164.front.sepia.ceph.com 2026-02-12T21:57:37.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:57:37.647 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T21:57:37.662 DEBUG:teuthology.orchestra.run.trial020:> uname -m 2026-02-12T21:57:37.679 INFO:teuthology.orchestra.run.trial020.stdout:x86_64 2026-02-12T21:57:37.679 DEBUG:teuthology.orchestra.run.trial020:> cat /etc/os-release 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:NAME="Rocky Linux" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:ID="rocky" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:VERSION_ID="10.1" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:PLATFORM_ID="platform:el10" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:ANSI_COLOR="0;32" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:LOGO="fedora-logo-icon" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:VENDOR_NAME="RESF" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:SUPPORT_END="2035-05-31" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T21:57:37.736 INFO:teuthology.orchestra.run.trial020.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T21:57:37.737 INFO:teuthology.lock.ops:Updating trial020.front.sepia.ceph.com on lock server 2026-02-12T21:57:37.801 DEBUG:teuthology.orchestra.run.trial164:> uname -m 2026-02-12T21:57:37.818 INFO:teuthology.orchestra.run.trial164.stdout:x86_64 2026-02-12T21:57:37.818 DEBUG:teuthology.orchestra.run.trial164:> cat /etc/os-release 2026-02-12T21:57:37.875 INFO:teuthology.orchestra.run.trial164.stdout:NAME="Rocky Linux" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:ID="rocky" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:VERSION_ID="10.1" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:PLATFORM_ID="platform:el10" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:ANSI_COLOR="0;32" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:LOGO="fedora-logo-icon" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:VENDOR_NAME="RESF" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:SUPPORT_END="2035-05-31" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T21:57:37.876 INFO:teuthology.orchestra.run.trial164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T21:57:37.876 INFO:teuthology.lock.ops:Updating trial164.front.sepia.ceph.com on lock server 2026-02-12T21:57:37.958 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T21:57:37.971 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T21:57:37.982 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T21:57:37.982 DEBUG:teuthology.orchestra.run.trial020:> test '!' -e /home/ubuntu/cephtest 2026-02-12T21:57:37.984 DEBUG:teuthology.orchestra.run.trial164:> test '!' -e /home/ubuntu/cephtest 2026-02-12T21:57:38.000 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T21:57:38.011 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T21:57:38.011 DEBUG:teuthology.orchestra.run.trial020:> test -z $(ls -A /var/lib/ceph) 2026-02-12T21:57:38.040 DEBUG:teuthology.orchestra.run.trial164:> test -z $(ls -A /var/lib/ceph) 2026-02-12T21:57:38.055 INFO:teuthology.orchestra.run.trial020.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T21:57:38.058 INFO:teuthology.orchestra.run.trial164.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T21:57:38.058 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T21:57:38.220 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T21:57:38.240 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'sha1': 'distro'} 2026-02-12T21:57:38.240 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2026-02-12T21:57:38.240 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2026-02-12T21:57:38.240 DEBUG:teuthology.orchestra.run.trial020:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T21:57:38.240 DEBUG:teuthology.orchestra.run.trial164:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T21:57:38.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T21:57:38.256 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:57:38.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T21:57:38.256 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:57:38.313 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:57:38.313 INFO:teuthology.task.kernel:Running kernel on trial164: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:57:38.314 DEBUG:teuthology.orchestra.run.trial164:> sudo yum install -y kernel 2026-02-12T21:57:38.314 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:57:38.314 INFO:teuthology.task.kernel:Running kernel on trial020: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:57:38.315 DEBUG:teuthology.orchestra.run.trial020:> sudo yum install -y kernel 2026-02-12T21:57:38.842 INFO:teuthology.orchestra.run.trial164.stdout:Rocky Linux 10 - AppStream 17 MB/s | 2.2 MB 00:00 2026-02-12T21:57:38.917 INFO:teuthology.orchestra.run.trial020.stdout:Rocky Linux 10 - AppStream 11 MB/s | 2.2 MB 00:00 2026-02-12T21:57:39.223 INFO:teuthology.orchestra.run.trial164.stdout:Rocky Linux 10 - BaseOS 43 MB/s | 11 MB 00:00 2026-02-12T21:57:39.289 INFO:teuthology.orchestra.run.trial020.stdout:Rocky Linux 10 - BaseOS 44 MB/s | 11 MB 00:00 2026-02-12T21:57:39.725 INFO:teuthology.orchestra.run.trial164.stdout:Rocky Linux 10 - CRB 5.2 MB/s | 507 kB 00:00 2026-02-12T21:57:39.932 INFO:teuthology.orchestra.run.trial020.stdout:Rocky Linux 10 - CRB 2.1 MB/s | 503 kB 00:00 2026-02-12T21:57:40.102 INFO:teuthology.orchestra.run.trial164.stdout:Extra Packages for Enterprise Linux 19 MB/s | 6.2 MB 00:00 2026-02-12T21:57:40.661 INFO:teuthology.orchestra.run.trial020.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 6.2 MB 00:00 2026-02-12T21:57:40.763 INFO:teuthology.orchestra.run.trial164.stdout:lab-extras 207 kB/s | 3.7 kB 00:00 2026-02-12T21:57:41.171 INFO:teuthology.orchestra.run.trial164.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T21:57:41.183 INFO:teuthology.orchestra.run.trial164.stdout:Dependencies resolved. 2026-02-12T21:57:41.184 INFO:teuthology.orchestra.run.trial164.stdout:================================================================================ 2026-02-12T21:57:41.184 INFO:teuthology.orchestra.run.trial164.stdout: Package Arch Version Repo Size 2026-02-12T21:57:41.184 INFO:teuthology.orchestra.run.trial164.stdout:================================================================================ 2026-02-12T21:57:41.184 INFO:teuthology.orchestra.run.trial164.stdout:Installing: 2026-02-12T21:57:41.184 INFO:teuthology.orchestra.run.trial164.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T21:57:41.184 INFO:teuthology.orchestra.run.trial164.stdout:Installing dependencies: 2026-02-12T21:57:41.184 INFO:teuthology.orchestra.run.trial164.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T21:57:41.184 INFO:teuthology.orchestra.run.trial164.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T21:57:41.184 INFO:teuthology.orchestra.run.trial164.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T21:57:41.185 INFO:teuthology.orchestra.run.trial164.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T21:57:41.185 INFO:teuthology.orchestra.run.trial164.stdout: 2026-02-12T21:57:41.185 INFO:teuthology.orchestra.run.trial164.stdout:Transaction Summary 2026-02-12T21:57:41.185 INFO:teuthology.orchestra.run.trial164.stdout:================================================================================ 2026-02-12T21:57:41.185 INFO:teuthology.orchestra.run.trial164.stdout:Install 5 Packages 2026-02-12T21:57:41.185 INFO:teuthology.orchestra.run.trial164.stdout: 2026-02-12T21:57:41.185 INFO:teuthology.orchestra.run.trial164.stdout:Total download size: 93 M 2026-02-12T21:57:41.185 INFO:teuthology.orchestra.run.trial164.stdout:Installed size: 135 M 2026-02-12T21:57:41.185 INFO:teuthology.orchestra.run.trial164.stdout:Downloading Packages: 2026-02-12T21:57:41.324 INFO:teuthology.orchestra.run.trial020.stdout:lab-extras 318 kB/s | 3.7 kB 00:00 2026-02-12T21:57:41.346 INFO:teuthology.orchestra.run.trial164.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 8.5 MB/s | 1.4 MB 00:00 2026-02-12T21:57:41.488 INFO:teuthology.orchestra.run.trial164.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 61 MB/s | 18 MB 00:00 2026-02-12T21:57:41.543 INFO:teuthology.orchestra.run.trial164.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 51 MB/s | 2.8 MB 00:00 2026-02-12T21:57:41.738 INFO:teuthology.orchestra.run.trial020.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T21:57:41.750 INFO:teuthology.orchestra.run.trial020.stdout:Dependencies resolved. 2026-02-12T21:57:41.751 INFO:teuthology.orchestra.run.trial020.stdout:================================================================================ 2026-02-12T21:57:41.751 INFO:teuthology.orchestra.run.trial020.stdout: Package Arch Version Repo Size 2026-02-12T21:57:41.751 INFO:teuthology.orchestra.run.trial020.stdout:================================================================================ 2026-02-12T21:57:41.751 INFO:teuthology.orchestra.run.trial020.stdout:Installing: 2026-02-12T21:57:41.752 INFO:teuthology.orchestra.run.trial020.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T21:57:41.752 INFO:teuthology.orchestra.run.trial020.stdout:Installing dependencies: 2026-02-12T21:57:41.752 INFO:teuthology.orchestra.run.trial020.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T21:57:41.752 INFO:teuthology.orchestra.run.trial020.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T21:57:41.752 INFO:teuthology.orchestra.run.trial020.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T21:57:41.752 INFO:teuthology.orchestra.run.trial020.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T21:57:41.752 INFO:teuthology.orchestra.run.trial020.stdout: 2026-02-12T21:57:41.752 INFO:teuthology.orchestra.run.trial020.stdout:Transaction Summary 2026-02-12T21:57:41.752 INFO:teuthology.orchestra.run.trial020.stdout:================================================================================ 2026-02-12T21:57:41.752 INFO:teuthology.orchestra.run.trial020.stdout:Install 5 Packages 2026-02-12T21:57:41.752 INFO:teuthology.orchestra.run.trial020.stdout: 2026-02-12T21:57:41.753 INFO:teuthology.orchestra.run.trial020.stdout:Total download size: 93 M 2026-02-12T21:57:41.753 INFO:teuthology.orchestra.run.trial020.stdout:Installed size: 135 M 2026-02-12T21:57:41.753 INFO:teuthology.orchestra.run.trial020.stdout:Downloading Packages: 2026-02-12T21:57:41.804 INFO:teuthology.orchestra.run.trial020.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 26 MB/s | 1.4 MB 00:00 2026-02-12T21:57:41.850 INFO:teuthology.orchestra.run.trial164.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 59 MB/s | 30 MB 00:00 2026-02-12T21:57:41.936 INFO:teuthology.orchestra.run.trial164.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 54 MB/s | 41 MB 00:00 2026-02-12T21:57:41.937 INFO:teuthology.orchestra.run.trial164.stdout:-------------------------------------------------------------------------------- 2026-02-12T21:57:41.937 INFO:teuthology.orchestra.run.trial164.stdout:Total 123 MB/s | 93 MB 00:00 2026-02-12T21:57:41.937 INFO:teuthology.orchestra.run.trial164.stdout:Running transaction check 2026-02-12T21:57:42.026 INFO:teuthology.orchestra.run.trial020.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 67 MB/s | 18 MB 00:00 2026-02-12T21:57:42.076 INFO:teuthology.orchestra.run.trial020.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 56 MB/s | 2.8 MB 00:00 2026-02-12T21:57:42.083 INFO:teuthology.orchestra.run.trial164.stdout:Transaction check succeeded. 2026-02-12T21:57:42.083 INFO:teuthology.orchestra.run.trial164.stdout:Running transaction test 2026-02-12T21:57:42.165 INFO:teuthology.orchestra.run.trial020.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 82 MB/s | 30 MB 00:00 2026-02-12T21:57:42.280 INFO:teuthology.orchestra.run.trial020.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 77 MB/s | 41 MB 00:00 2026-02-12T21:57:42.281 INFO:teuthology.orchestra.run.trial020.stdout:-------------------------------------------------------------------------------- 2026-02-12T21:57:42.281 INFO:teuthology.orchestra.run.trial020.stdout:Total 175 MB/s | 93 MB 00:00 2026-02-12T21:57:42.281 INFO:teuthology.orchestra.run.trial020.stdout:Running transaction check 2026-02-12T21:57:42.430 INFO:teuthology.orchestra.run.trial020.stdout:Transaction check succeeded. 2026-02-12T21:57:42.430 INFO:teuthology.orchestra.run.trial020.stdout:Running transaction test 2026-02-12T21:57:42.487 INFO:teuthology.orchestra.run.trial164.stdout:Transaction test succeeded. 2026-02-12T21:57:42.487 INFO:teuthology.orchestra.run.trial164.stdout:Running transaction 2026-02-12T21:57:42.833 INFO:teuthology.orchestra.run.trial020.stdout:Transaction test succeeded. 2026-02-12T21:57:42.833 INFO:teuthology.orchestra.run.trial020.stdout:Running transaction 2026-02-12T21:57:43.181 INFO:teuthology.orchestra.run.trial164.stdout: Preparing : 1/1 2026-02-12T21:57:43.382 INFO:teuthology.orchestra.run.trial164.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T21:57:43.403 INFO:teuthology.orchestra.run.trial164.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T21:57:43.528 INFO:teuthology.orchestra.run.trial020.stdout: Preparing : 1/1 2026-02-12T21:57:43.730 INFO:teuthology.orchestra.run.trial020.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T21:57:43.751 INFO:teuthology.orchestra.run.trial020.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T21:57:44.669 INFO:teuthology.orchestra.run.trial164.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T21:57:44.697 INFO:teuthology.orchestra.run.trial164.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T21:57:45.016 INFO:teuthology.orchestra.run.trial020.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T21:57:45.045 INFO:teuthology.orchestra.run.trial020.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T21:57:46.541 INFO:teuthology.orchestra.run.trial164.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T21:57:46.547 INFO:teuthology.orchestra.run.trial164.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T21:57:46.893 INFO:teuthology.orchestra.run.trial020.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T21:57:46.899 INFO:teuthology.orchestra.run.trial020.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T21:57:48.410 INFO:teuthology.orchestra.run.trial164.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T21:57:48.421 INFO:teuthology.orchestra.run.trial164.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T21:57:48.758 INFO:teuthology.orchestra.run.trial020.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T21:57:48.768 INFO:teuthology.orchestra.run.trial020.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T21:57:50.284 INFO:teuthology.orchestra.run.trial164.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T21:57:50.631 INFO:teuthology.orchestra.run.trial020.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T21:58:24.089 INFO:teuthology.orchestra.run.trial164.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T21:58:24.112 INFO:teuthology.orchestra.run.trial164.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T21:58:24.329 INFO:teuthology.orchestra.run.trial020.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T21:58:24.347 INFO:teuthology.orchestra.run.trial164.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T21:58:24.347 INFO:teuthology.orchestra.run.trial164.stdout: 2026-02-12T21:58:24.347 INFO:teuthology.orchestra.run.trial164.stdout:Installed: 2026-02-12T21:58:24.347 INFO:teuthology.orchestra.run.trial164.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.347 INFO:teuthology.orchestra.run.trial164.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.347 INFO:teuthology.orchestra.run.trial164.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.348 INFO:teuthology.orchestra.run.trial164.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.348 INFO:teuthology.orchestra.run.trial164.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.348 INFO:teuthology.orchestra.run.trial164.stdout: 2026-02-12T21:58:24.348 INFO:teuthology.orchestra.run.trial164.stdout:Complete! 2026-02-12T21:58:24.352 INFO:teuthology.orchestra.run.trial020.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T21:58:24.411 DEBUG:teuthology.orchestra.run.trial164:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T21:58:24.445 INFO:teuthology.orchestra.run.trial164.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.447 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.447 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.447 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T21:58:24.447 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T21:58:24.447 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2026-02-12T21:58:24.447 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial164.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T21:58:24.448 DEBUG:teuthology.orchestra.run.trial164:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T21:58:24.519 INFO:teuthology.orchestra.run.trial164.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.521 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.521 DEBUG:teuthology.orchestra.run.trial164:> sudo rpm -qi grub2-tools 2026-02-12T21:58:24.583 INFO:teuthology.orchestra.run.trial020.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T21:58:24.584 INFO:teuthology.orchestra.run.trial020.stdout: 2026-02-12T21:58:24.584 INFO:teuthology.orchestra.run.trial020.stdout:Installed: 2026-02-12T21:58:24.584 INFO:teuthology.orchestra.run.trial020.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.584 INFO:teuthology.orchestra.run.trial020.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.584 INFO:teuthology.orchestra.run.trial020.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.584 INFO:teuthology.orchestra.run.trial020.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.584 INFO:teuthology.orchestra.run.trial020.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.584 INFO:teuthology.orchestra.run.trial020.stdout: 2026-02-12T21:58:24.584 INFO:teuthology.orchestra.run.trial020.stdout:Complete! 2026-02-12T21:58:24.592 INFO:teuthology.orchestra.run.trial164.stdout:Name : grub2-tools 2026-02-12T21:58:24.592 INFO:teuthology.orchestra.run.trial164.stdout:Epoch : 1 2026-02-12T21:58:24.592 INFO:teuthology.orchestra.run.trial164.stdout:Version : 2.12 2026-02-12T21:58:24.592 INFO:teuthology.orchestra.run.trial164.stdout:Release : 29.el10_1 2026-02-12T21:58:24.592 INFO:teuthology.orchestra.run.trial164.stdout:Architecture: x86_64 2026-02-12T21:58:24.592 INFO:teuthology.orchestra.run.trial164.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T21:58:24.592 INFO:teuthology.orchestra.run.trial164.stdout:Group : Unspecified 2026-02-12T21:58:24.593 INFO:teuthology.orchestra.run.trial164.stdout:Size : 7963769 2026-02-12T21:58:24.593 INFO:teuthology.orchestra.run.trial164.stdout:License : GPL-3.0-or-later 2026-02-12T21:58:24.593 INFO:teuthology.orchestra.run.trial164.stdout:Signature : 2026-02-12T21:58:24.593 INFO:teuthology.orchestra.run.trial164.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T21:58:24.593 INFO:teuthology.orchestra.run.trial164.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T21:58:24.593 INFO:teuthology.orchestra.run.trial164.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T21:58:24.593 INFO:teuthology.orchestra.run.trial164.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T21:58:24.593 INFO:teuthology.orchestra.run.trial164.stdout:Packager : Release Engineering 2026-02-12T21:58:24.593 INFO:teuthology.orchestra.run.trial164.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T21:58:24.593 INFO:teuthology.orchestra.run.trial164.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T21:58:24.593 INFO:teuthology.orchestra.run.trial164.stdout:Summary : Support tools for GRUB. 2026-02-12T21:58:24.593 INFO:teuthology.orchestra.run.trial164.stdout:Description : 2026-02-12T21:58:24.594 INFO:teuthology.orchestra.run.trial164.stdout: 2026-02-12T21:58:24.594 INFO:teuthology.orchestra.run.trial164.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T21:58:24.594 INFO:teuthology.orchestra.run.trial164.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T21:58:24.594 INFO:teuthology.orchestra.run.trial164.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T21:58:24.594 INFO:teuthology.orchestra.run.trial164.stdout:hardware devices. 2026-02-12T21:58:24.594 INFO:teuthology.orchestra.run.trial164.stdout: 2026-02-12T21:58:24.594 INFO:teuthology.orchestra.run.trial164.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T21:58:24.595 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T21:58:24.595 INFO:teuthology.task.kernel:Updating grub on trial164 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.596 DEBUG:teuthology.orchestra.run.trial164:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T21:58:24.646 DEBUG:teuthology.orchestra.run.trial020:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T21:58:24.661 INFO:teuthology.orchestra.run.trial164.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T21:58:24.662 DEBUG:teuthology.orchestra.run.trial164:> sudo command -v grubby && echo yes || echo no 2026-02-12T21:58:24.679 INFO:teuthology.orchestra.run.trial020.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.679 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.679 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.679 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T21:58:24.679 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T21:58:24.679 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2026-02-12T21:58:24.679 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial020.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T21:58:24.679 DEBUG:teuthology.orchestra.run.trial020:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T21:58:24.727 INFO:teuthology.orchestra.run.trial164.stdout:/sbin/grubby 2026-02-12T21:58:24.728 INFO:teuthology.orchestra.run.trial164.stdout:yes 2026-02-12T21:58:24.728 DEBUG:teuthology.orchestra.run.trial164:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T21:58:24.751 INFO:teuthology.orchestra.run.trial020.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.751 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.751 DEBUG:teuthology.orchestra.run.trial020:> sudo rpm -qi grub2-tools 2026-02-12T21:58:24.796 INFO:teuthology.orchestra.run.trial164.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T21:58:24.797 DEBUG:teuthology.orchestra.run.trial164:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.824 INFO:teuthology.orchestra.run.trial020.stdout:Name : grub2-tools 2026-02-12T21:58:24.824 INFO:teuthology.orchestra.run.trial020.stdout:Epoch : 1 2026-02-12T21:58:24.824 INFO:teuthology.orchestra.run.trial020.stdout:Version : 2.12 2026-02-12T21:58:24.824 INFO:teuthology.orchestra.run.trial020.stdout:Release : 29.el10_1 2026-02-12T21:58:24.824 INFO:teuthology.orchestra.run.trial020.stdout:Architecture: x86_64 2026-02-12T21:58:24.824 INFO:teuthology.orchestra.run.trial020.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T21:58:24.824 INFO:teuthology.orchestra.run.trial020.stdout:Group : Unspecified 2026-02-12T21:58:24.825 INFO:teuthology.orchestra.run.trial020.stdout:Size : 7963769 2026-02-12T21:58:24.825 INFO:teuthology.orchestra.run.trial020.stdout:License : GPL-3.0-or-later 2026-02-12T21:58:24.825 INFO:teuthology.orchestra.run.trial020.stdout:Signature : 2026-02-12T21:58:24.825 INFO:teuthology.orchestra.run.trial020.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T21:58:24.825 INFO:teuthology.orchestra.run.trial020.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T21:58:24.825 INFO:teuthology.orchestra.run.trial020.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T21:58:24.825 INFO:teuthology.orchestra.run.trial020.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T21:58:24.825 INFO:teuthology.orchestra.run.trial020.stdout:Packager : Release Engineering 2026-02-12T21:58:24.825 INFO:teuthology.orchestra.run.trial020.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T21:58:24.825 INFO:teuthology.orchestra.run.trial020.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T21:58:24.825 INFO:teuthology.orchestra.run.trial020.stdout:Summary : Support tools for GRUB. 2026-02-12T21:58:24.825 INFO:teuthology.orchestra.run.trial020.stdout:Description : 2026-02-12T21:58:24.826 INFO:teuthology.orchestra.run.trial020.stdout: 2026-02-12T21:58:24.826 INFO:teuthology.orchestra.run.trial020.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T21:58:24.826 INFO:teuthology.orchestra.run.trial020.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T21:58:24.826 INFO:teuthology.orchestra.run.trial020.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T21:58:24.826 INFO:teuthology.orchestra.run.trial020.stdout:hardware devices. 2026-02-12T21:58:24.826 INFO:teuthology.orchestra.run.trial020.stdout: 2026-02-12T21:58:24.826 INFO:teuthology.orchestra.run.trial020.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T21:58:24.827 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T21:58:24.827 INFO:teuthology.task.kernel:Updating grub on trial020 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:24.827 DEBUG:teuthology.orchestra.run.trial020:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T21:58:24.873 DEBUG:teuthology.orchestra.run.trial164:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T21:58:24.893 INFO:teuthology.orchestra.run.trial020.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T21:58:24.894 DEBUG:teuthology.orchestra.run.trial020:> sudo command -v grubby && echo yes || echo no 2026-02-12T21:58:24.960 INFO:teuthology.orchestra.run.trial020.stdout:/sbin/grubby 2026-02-12T21:58:24.961 INFO:teuthology.orchestra.run.trial020.stdout:yes 2026-02-12T21:58:24.962 DEBUG:teuthology.orchestra.run.trial020:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T21:58:24.987 INFO:teuthology.orchestra.run.trial164.stderr:Generating grub configuration file ... 2026-02-12T21:58:25.028 INFO:teuthology.orchestra.run.trial020.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T21:58:25.029 DEBUG:teuthology.orchestra.run.trial020:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:25.105 DEBUG:teuthology.orchestra.run.trial020:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T21:58:25.169 INFO:teuthology.orchestra.run.trial164.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T21:58:25.178 INFO:teuthology.orchestra.run.trial164.stderr:done 2026-02-12T21:58:25.180 DEBUG:teuthology.orchestra.run.trial164:> test -d /sys/firmware/efi 2026-02-12T21:58:25.197 DEBUG:teuthology.orchestra.run.trial164:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T21:58:25.215 INFO:teuthology.orchestra.run.trial020.stderr:Generating grub configuration file ... 2026-02-12T21:58:25.264 INFO:teuthology.orchestra.run.trial164.stdout:/boot/efi/EFI/BOOT 2026-02-12T21:58:25.265 INFO:teuthology.orchestra.run.trial164.stdout:/boot/efi/EFI/rocky 2026-02-12T21:58:25.266 DEBUG:teuthology.orchestra.run.trial164:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T21:58:25.334 INFO:teuthology.orchestra.run.trial164.stdout:no 2026-02-12T21:58:25.335 DEBUG:teuthology.orchestra.run.trial164:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T21:58:25.390 INFO:teuthology.orchestra.run.trial020.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T21:58:25.399 INFO:teuthology.orchestra.run.trial020.stderr:done 2026-02-12T21:58:25.401 INFO:teuthology.orchestra.run.trial164.stdout:yes 2026-02-12T21:58:25.402 DEBUG:teuthology.orchestra.run.trial164:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T21:58:25.403 DEBUG:teuthology.orchestra.run.trial020:> test -d /sys/firmware/efi 2026-02-12T21:58:25.421 DEBUG:teuthology.orchestra.run.trial020:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T21:58:25.468 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial164 2026-02-12T21:58:25.469 DEBUG:teuthology.orchestra.run.trial164:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T21:58:25.493 INFO:teuthology.orchestra.run.trial020.stdout:/boot/efi/EFI/BOOT 2026-02-12T21:58:25.493 INFO:teuthology.orchestra.run.trial020.stdout:/boot/efi/EFI/rocky 2026-02-12T21:58:25.494 DEBUG:teuthology.orchestra.run.trial020:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T21:58:25.534 INFO:teuthology.orchestra.run.trial164.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T21:58:25.562 INFO:teuthology.orchestra.run.trial020.stdout:no 2026-02-12T21:58:25.562 DEBUG:teuthology.orchestra.run.trial020:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T21:58:25.628 INFO:teuthology.orchestra.run.trial020.stdout:yes 2026-02-12T21:58:25.629 DEBUG:teuthology.orchestra.run.trial020:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T21:58:25.696 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial020 2026-02-12T21:58:25.696 DEBUG:teuthology.orchestra.run.trial020:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T21:58:25.761 INFO:teuthology.orchestra.run.trial020.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T21:58:55.512 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:58:55.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:58:55.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:58:55.622 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:58:55.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:58:55.701 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:58:55.702 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:58:55.739 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:58:55.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:58:55.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:58:55.835 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:58:55.835 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:55.835 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:58:55.835 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:58:55.846 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:58:55.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:58:55.930 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:58:55.930 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:58:55.987 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:58:55.988 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:55.988 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:58:55.988 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:58:56.836 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:58:56.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:58:56.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:58:56.947 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:58:56.990 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:58:56.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:58:56.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:58:57.087 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:58:57.095 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:58:57.095 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:58:57.095 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:58:57.151 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:58:57.152 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:57.152 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:58:57.152 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:58:57.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:58:57.164 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:58:57.164 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:58:57.221 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:58:57.221 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:57.222 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:58:57.222 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:58:58.153 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:58:58.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:58:58.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:58:58.252 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:58:58.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:58:58.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:58:58.303 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:58:58.314 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:58:58.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:58:58.363 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:58:58.363 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:58:58.388 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:58:58.389 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:58:58.389 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:58:58.418 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:58:58.419 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:58.419 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:58:58.419 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:58:58.447 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:58:58.448 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:58.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:58:58.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:58:59.420 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:58:59.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:58:59.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:58:59.478 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:58:59.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:58:59.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:58:59.529 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:58:59.539 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:58:59.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:58:59.588 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:58:59.588 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:58:59.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:58:59.615 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:58:59.615 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:58:59.645 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:58:59.645 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:59.645 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:58:59.645 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:58:59.672 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:58:59.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:58:59.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:58:59.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:00.646 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:00.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:00.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:00.745 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:00.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:00.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:00.797 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:00.808 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:00.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:00.856 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:00.856 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:00.881 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:00.881 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:00.881 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:00.913 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:00.914 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:00.914 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:00.914 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:00.938 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:00.938 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:00.938 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:00.938 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:01.915 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:01.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:01.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:01.972 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:01.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:01.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:02.023 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:02.034 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:02.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:02.083 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:02.083 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:02.111 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:02.111 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:02.111 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:02.140 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:02.140 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:02.140 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:02.140 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:02.168 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:02.168 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:02.168 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:02.168 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:03.141 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:03.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:03.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:03.239 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:03.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:03.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:03.292 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:03.302 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:03.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:03.350 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:03.350 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:03.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:03.377 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:03.377 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:03.407 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:03.407 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:03.407 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:03.407 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:03.434 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:03.434 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:03.434 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:03.434 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:04.408 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:04.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:04.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:04.505 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:04.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:04.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:04.557 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:04.568 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:04.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:04.616 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:04.616 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:04.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:04.659 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:04.659 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:04.673 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:04.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:04.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:04.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:04.717 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:04.718 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:04.718 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:04.718 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:05.675 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:05.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:05.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:05.773 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:05.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:05.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:05.824 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:05.834 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:05.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:05.884 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:05.884 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:05.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:05.921 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:05.921 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:05.940 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:05.941 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:05.941 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:05.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:05.978 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:05.979 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:05.979 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:05.979 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:06.942 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:06.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:06.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:07.042 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:07.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:07.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:07.094 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:07.104 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:07.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:07.153 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:07.153 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:07.188 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:07.188 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:07.188 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:07.211 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:07.211 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:07.211 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:07.211 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:07.245 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:07.246 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:07.246 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:07.246 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:08.212 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:08.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:08.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:08.312 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:08.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:08.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:08.363 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:08.373 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:08.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:08.422 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:08.422 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:08.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:08.445 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:08.445 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:08.479 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:08.479 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:08.479 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:08.479 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:08.502 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:08.502 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:08.503 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:08.503 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:09.480 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:09.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:09.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:09.579 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:09.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:09.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:09.632 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:09.642 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:09.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:09.692 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:09.692 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:09.723 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:09.724 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:09.724 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:09.748 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:09.748 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:09.749 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:09.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:09.781 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:09.781 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:09.781 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:09.782 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:10.750 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:10.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:10.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:10.849 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:10.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:10.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:10.901 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:10.911 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:10.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:10.960 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:10.960 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:11.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:11.000 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:11.001 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:11.017 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:11.017 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:11.017 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:11.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:11.057 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:11.058 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:11.058 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:11.058 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:12.019 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:12.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:12.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:12.118 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:12.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:12.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:12.170 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:12.180 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:12.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:12.229 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:12.229 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:12.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:12.255 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:12.255 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:12.285 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:12.285 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:12.285 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:12.285 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:12.312 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:12.313 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:12.313 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:12.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:13.286 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:13.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:13.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:13.386 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:13.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:13.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:13.440 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:13.450 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:13.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:13.458 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:13.458 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:13.515 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:13.516 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:13.516 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:13.516 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:13.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:13.527 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:13.527 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:13.585 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:13.585 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:13.585 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:13.585 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:14.516 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:14.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:14.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:14.615 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:14.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:14.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:14.666 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:14.676 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:14.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:14.726 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:14.727 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:14.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:14.760 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:14.760 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:14.784 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:14.784 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:14.784 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:14.785 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:14.817 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:14.818 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:14.818 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:14.818 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:15.785 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:15.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:15.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:15.883 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:15.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:15.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:15.934 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:15.944 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:15.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:15.994 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:15.994 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:16.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:16.017 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:16.017 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:16.051 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:16.051 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:16.051 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:16.051 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:16.074 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:16.075 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:16.075 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:16.075 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:17.053 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:17.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:17.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:17.151 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:17.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:17.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:17.208 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:17.218 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:17.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:17.266 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:17.266 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:17.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:17.301 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:17.301 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:17.323 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:17.323 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:17.324 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:17.324 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:17.358 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:17.358 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:17.358 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:17.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:18.325 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:18.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:18.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:18.426 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:18.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:18.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:18.451 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:18.553 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:18.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:18.560 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:18.560 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:18.617 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:18.617 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:18.618 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:18.618 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:18.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:18.631 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:18.631 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:18.689 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:18.689 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:18.689 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:18.689 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:19.618 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:19.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:19.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:19.718 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:19.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:19.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:19.770 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:19.780 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:19.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:19.829 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:19.829 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:19.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:19.863 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:19.863 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:19.885 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:19.885 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:19.885 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:19.885 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:19.920 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:19.920 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:19.920 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:19.921 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:20.886 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:20.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:20.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:20.983 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:20.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:20.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:21.040 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:21.049 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:21.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:21.056 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:21.056 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:21.113 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:21.113 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:21.113 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:21.113 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:21.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:21.124 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:21.124 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:21.181 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:21.181 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:21.181 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:21.182 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:22.114 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:22.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:22.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:22.213 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:22.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:22.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:22.266 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:22.276 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:22.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:22.326 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:22.326 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:22.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:22.361 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:22.361 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:22.383 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:22.383 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:22.383 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:22.383 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:22.417 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:22.418 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:22.418 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:22.418 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:23.384 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:23.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:23.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:23.437 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:23.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:23.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:23.488 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:23.499 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:23.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:23.548 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:23.548 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:23.579 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:23.579 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:23.579 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:23.604 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:23.604 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:23.604 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:23.604 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:23.635 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:23.635 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:23.635 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:23.636 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:24.605 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:24.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:24.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:24.704 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:24.704 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:24.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:24.756 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:24.766 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:24.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:24.815 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:24.815 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:24.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:24.842 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:24.843 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:24.872 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:24.872 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:24.872 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:24.872 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:24.899 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:24.899 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:24.899 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:24.899 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:25.873 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:25.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:25.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:25.972 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:25.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:25.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:26.024 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:26.034 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:26.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:26.082 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:26.082 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:26.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:26.114 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:26.114 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:26.139 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:26.139 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:26.139 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:26.139 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:26.170 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:26.171 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:26.171 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:26.171 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:27.140 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:27.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:27.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:27.238 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:27.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:27.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:27.291 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:27.301 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:27.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:27.349 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:27.349 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:27.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:27.377 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:27.378 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:27.406 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:27.406 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:27.406 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:27.406 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:27.435 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:27.436 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:27.436 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:27.436 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:28.406 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:28.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:28.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:28.460 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:28.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:28.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:28.512 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:28.522 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:28.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:28.571 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:28.571 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:28.596 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:28.596 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:28.596 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:28.627 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:28.627 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:28.627 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:28.627 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:28.653 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:28.653 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:28.653 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:28.653 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:29.628 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:29.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:29.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:29.726 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:29.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:29.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:29.777 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:29.788 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:29.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:29.837 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:29.837 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:29.861 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:29.861 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:29.861 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:29.893 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:29.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:29.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:29.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:29.918 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:29.918 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:29.918 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:29.918 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:30.894 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:30.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:30.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:30.994 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:30.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:30.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:31.046 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:31.056 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:31.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:31.104 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:31.104 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:31.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:31.140 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:31.140 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:31.162 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:31.162 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:31.162 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:31.162 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:31.197 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:31.198 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:31.198 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:31.198 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:32.164 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:32.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:32.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:32.263 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:32.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:32.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:32.315 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:32.325 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:32.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:32.374 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:32.374 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:32.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:32.396 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:32.396 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:32.431 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:32.431 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:32.431 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:32.431 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:32.453 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:32.454 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:32.454 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:32.454 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:33.432 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:33.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:33.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:33.531 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:33.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:33.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:33.583 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:33.594 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:33.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:33.643 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:33.643 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:33.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:33.668 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:33.668 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:33.701 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:33.701 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:33.701 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:33.701 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:33.725 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:33.725 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:33.726 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:33.726 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:34.703 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:34.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:34.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:34.803 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:34.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:34.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:34.855 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:34.866 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:34.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:34.914 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:34.914 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:34.942 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:34.942 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:34.942 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:34.970 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:34.970 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:34.970 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:34.970 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:34.999 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:35.000 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:35.000 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:35.000 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:35.971 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:35.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:35.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:36.069 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:36.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:36.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:36.122 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:36.131 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:36.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:36.181 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:36.181 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:36.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:36.204 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:36.204 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:36.238 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:36.239 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:36.239 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:36.239 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:36.261 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:36.261 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:36.261 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:36.261 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:37.241 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:37.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:37.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:37.294 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:37.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:37.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:37.344 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:37.354 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:37.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:37.404 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:37.404 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:37.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:37.430 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:37.430 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:37.461 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:37.461 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:37.461 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:37.461 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:37.487 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:37.487 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:37.487 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:37.487 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:38.462 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:38.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:38.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:38.560 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:38.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:38.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:38.627 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:38.635 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:38.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:38.643 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:38.643 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:38.699 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:38.699 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:38.699 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:38.700 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:38.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:38.709 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:38.709 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:38.767 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:38.767 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:38.767 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:38.767 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:39.701 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:39.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:39.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:39.799 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:39.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:39.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:39.851 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:39.862 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:39.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:39.910 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:39.910 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:39.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:39.949 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:39.949 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:39.967 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:39.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:39.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:39.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:40.008 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:40.008 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:40.008 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:40.009 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:40.968 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:40.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:40.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:41.025 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:41.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:41.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:41.077 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:41.087 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:41.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:41.135 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:41.136 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:41.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:41.159 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:41.159 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:41.193 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:41.193 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:41.193 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:41.194 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:41.215 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:41.215 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:41.215 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:41.215 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:42.195 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:42.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:42.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:42.248 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:42.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:42.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:42.300 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:42.311 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:42.360 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:42.360 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:42.360 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:42.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:42.384 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:42.384 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:42.417 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:42.418 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:42.418 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:42.418 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:42.441 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:42.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:42.441 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:42.442 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:43.419 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:43.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:43.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:43.520 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:43.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:43.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:43.571 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:43.581 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:43.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:43.631 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:43.631 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:43.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:43.669 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:43.669 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:43.687 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:43.687 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:43.687 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:43.687 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:43.726 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:43.727 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:43.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:43.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:44.688 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:44.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:44.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:44.788 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:44.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:44.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:44.850 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:44.860 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:44.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:44.868 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:44.868 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:44.927 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:44.927 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:44.927 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:44.927 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:44.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:44.946 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:44.946 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:45.003 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:45.004 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:45.004 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:45.004 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:45.928 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:45.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:45.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:46.027 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:46.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:46.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:46.079 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:46.089 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:46.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:46.137 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:46.138 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:46.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:46.170 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:46.170 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:46.194 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:46.194 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:46.194 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:46.194 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:46.227 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:46.227 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:46.227 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:46.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:47.195 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:47.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:47.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:47.294 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:47.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:47.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:47.346 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:47.356 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:47.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:47.403 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:47.403 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:47.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:47.431 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:47.431 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:47.459 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:47.459 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:47.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:47.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:47.488 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:47.488 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:47.489 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:47.489 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:48.461 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:48.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:48.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:48.559 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:48.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:48.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:48.612 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:48.622 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:48.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:48.670 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:48.670 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:48.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:48.693 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:48.693 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:48.728 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:48.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:48.729 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:48.729 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:48.751 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:48.751 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:48.751 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:48.752 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:49.730 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:49.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:49.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:49.829 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:49.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:49.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:49.881 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:49.891 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:49.940 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:49.940 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:49.940 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:49.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:49.967 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:49.968 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:49.996 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:49.996 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:49.996 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:49.996 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:50.025 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:50.026 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:50.026 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:50.026 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:50.997 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:50.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:50.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:51.095 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:51.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:51.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:51.147 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:51.157 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:51.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:51.206 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:51.206 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:51.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:51.229 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:51.229 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:51.263 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:51.263 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:51.263 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:51.263 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:51.286 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:51.286 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:51.286 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:51.286 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:52.264 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:52.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:52.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:52.361 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:52.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:52.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:52.414 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:52.424 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:52.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:52.473 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:52.473 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:52.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:52.503 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:52.503 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:52.529 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:52.529 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:52.529 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:52.529 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:52.560 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:52.561 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:52.561 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:52.561 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:53.530 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:53.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:53.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:53.629 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:53.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:53.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:53.681 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:53.691 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:53.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:53.740 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:53.741 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:53.769 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:53.769 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:53.769 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:53.797 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:53.797 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:53.797 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:53.797 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:53.826 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:53.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:53.826 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:53.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:54.798 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:54.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:54.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:54.896 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:54.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:54.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:54.948 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:54.958 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:55.008 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:55.008 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:55.008 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:55.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:55.044 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:55.044 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:55.065 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:55.065 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:55.065 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:55.065 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:55.101 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:55.101 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:55.101 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:55.101 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:56.066 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:56.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:56.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:56.165 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:56.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:56.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:56.227 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:56.237 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:56.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:56.245 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:56.245 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:56.302 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:56.302 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:56.302 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:56.302 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:56.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:56.308 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:56.308 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:56.366 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:56.366 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:56.366 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:56.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:57.303 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:57.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:57.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:57.403 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:57.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:57.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:57.455 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:57.466 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:57.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:57.473 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:57.473 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:57.530 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:57.531 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:57.531 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:57.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:57.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:57.544 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:57.544 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:57.603 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:57.603 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:57.603 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:57.603 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:58.531 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:58.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:58.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:58.630 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:58.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:58.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:58.697 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:58.707 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:58.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:58.714 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:58.714 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T21:59:58.771 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:58.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:58.772 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:58.772 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:58.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:58.794 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:58.794 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T21:59:58.851 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T21:59:58.852 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T21:59:58.852 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T21:59:58.852 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T21:59:59.773 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T21:59:59.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:59.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:59.871 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T21:59:59.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T21:59:59.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T21:59:59.923 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T21:59:59.933 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T21:59:59.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T21:59:59.982 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T21:59:59.982 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:00.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:00.018 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:00.018 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:00.039 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:00.039 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:00.039 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:00.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:00.075 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:00.075 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:00.075 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:00.076 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:01.040 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:01.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:01.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:01.139 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:01.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:01.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:01.205 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:01.215 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:01.222 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:01.223 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:01.223 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:01.279 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:01.279 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:01.280 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:01.280 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:01.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:01.289 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:01.289 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:01.347 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:01.347 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:01.347 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:01.347 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:02.280 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:02.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:02.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:02.378 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:02.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:02.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:02.431 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:02.441 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:02.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:02.491 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:02.491 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:02.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:02.519 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:02.519 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:02.548 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:02.549 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:02.549 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:02.549 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:02.576 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:02.577 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:02.577 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:02.577 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:03.550 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:03.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:03.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:03.649 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:03.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:03.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:03.702 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:03.712 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:03.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:03.761 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:03.761 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:03.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:03.792 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:03.792 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:03.817 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:03.817 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:03.818 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:03.818 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:03.849 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:03.849 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:03.849 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:03.849 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:04.819 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:04.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:04.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:04.917 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:04.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:04.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:04.972 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:04.983 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:04.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:04.990 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:04.990 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:05.047 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:05.047 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:05.047 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:05.047 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:05.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:05.069 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:05.069 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:05.126 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:05.127 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:05.127 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:05.127 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:06.048 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:06.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:06.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:06.147 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:06.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:06.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:06.199 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:06.209 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:06.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:06.258 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:06.258 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:06.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:06.286 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:06.286 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:06.315 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:06.315 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:06.315 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:06.315 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:06.343 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:06.343 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:06.343 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:06.343 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:07.316 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:07.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:07.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:07.416 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:07.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:07.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:07.468 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:07.478 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:07.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:07.527 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:07.527 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:07.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:07.559 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:07.559 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:07.586 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:07.586 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:07.586 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:07.586 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:07.617 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:07.618 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:07.618 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:07.618 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:08.587 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:08.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:08.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:08.686 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:08.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:08.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:08.738 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:08.748 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:08.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:08.797 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:08.797 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:08.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:08.825 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:08.825 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:08.855 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:08.855 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:08.855 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:08.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:08.882 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:08.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:08.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:08.883 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:09.857 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:09.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:09.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:09.955 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:09.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:09.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:10.006 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:10.016 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:10.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:10.065 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:10.065 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:10.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:10.105 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:10.105 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:10.121 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:10.122 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:10.122 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:10.122 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:10.162 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:10.162 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:10.163 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:10.163 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:11.123 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:11.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:11.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:11.183 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:11.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:11.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:11.234 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:11.244 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:11.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:11.293 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:11.293 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:11.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:11.333 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:11.333 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:11.349 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:11.350 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:11.350 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:11.350 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:11.390 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:11.391 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:11.391 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:11.391 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:12.351 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:12.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:12.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:12.449 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:12.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:12.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:12.501 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:12.511 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:12.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:12.560 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:12.560 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:12.593 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:12.593 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:12.593 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:12.617 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:12.617 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:12.617 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:12.617 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:12.652 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:12.653 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:12.653 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:12.653 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:13.618 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:13.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:13.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:13.718 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:13.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:13.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:13.770 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:13.780 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:13.827 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:13.827 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:13.827 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:13.857 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:13.858 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:13.858 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:13.884 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:13.884 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:13.885 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:13.885 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:13.914 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:13.915 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:13.915 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:13.915 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:14.886 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:14.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:14.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:14.984 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:14.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:14.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:15.036 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:15.046 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:15.095 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:15.095 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:15.095 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:15.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:15.124 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:15.124 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:15.152 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:15.152 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:15.152 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:15.152 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:15.180 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:15.180 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:15.180 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:15.181 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:16.153 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:16.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:16.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:16.251 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:16.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:16.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:16.303 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:16.312 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:16.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:16.362 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:16.362 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:16.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:16.383 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:16.383 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:16.420 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:16.421 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:16.421 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:16.421 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:16.440 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:16.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:16.441 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:16.441 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:17.423 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:17.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:17.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:17.520 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:17.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:17.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:17.572 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:17.582 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:17.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:17.631 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:17.631 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:17.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:17.667 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:17.667 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:17.688 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:17.688 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:17.688 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:17.688 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:17.725 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:17.725 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:17.725 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:17.725 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:18.689 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:18.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:18.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:18.787 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:18.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:18.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:18.839 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:18.849 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:18.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:18.895 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:18.896 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:18.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:18.931 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:18.931 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:18.952 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:18.953 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:18.953 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:18.953 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:18.988 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:18.988 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:18.989 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:18.989 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:19.954 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:19.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:19.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:20.051 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:20.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:20.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:20.102 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:20.112 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:20.160 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:20.160 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:20.160 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:20.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:20.194 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:20.194 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:20.217 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:20.217 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:20.217 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:20.217 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:20.252 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:20.252 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:20.252 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:20.252 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:21.219 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:21.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:21.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:21.317 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:21.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:21.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:21.369 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:21.380 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:21.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:21.387 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:21.387 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:21.445 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:21.445 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:21.445 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:21.445 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:21.453 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:21.453 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:21.453 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:21.511 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:21.511 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:21.511 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:21.511 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:22.446 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:22.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:22.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:22.542 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:22.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:22.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:22.593 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:22.603 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:22.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:22.652 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:22.652 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:22.676 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:22.676 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:22.676 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:22.709 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:22.710 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:22.710 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:22.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:22.733 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:22.734 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:22.734 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:22.734 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:23.711 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:23.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:23.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:23.809 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:23.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:23.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:23.860 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:23.870 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:23.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:23.919 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:23.919 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:23.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:23.953 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:23.954 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:23.977 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:23.977 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:23.977 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:23.977 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:24.011 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:24.011 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:24.011 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:24.011 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:24.978 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:24.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:24.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:25.076 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:25.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:25.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:25.129 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:25.139 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:25.187 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:25.187 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:25.188 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:25.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:25.221 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:25.221 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:25.244 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:25.244 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:25.244 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:25.244 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:25.279 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:25.279 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:25.279 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:25.279 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:26.245 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:26.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:26.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:26.344 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:26.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:26.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:26.396 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:26.406 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:26.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:26.454 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:26.455 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:26.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:26.483 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:26.483 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:26.511 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:26.512 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:26.512 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:26.512 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:26.541 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:26.541 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:26.541 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:26.541 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:27.513 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:27.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:27.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:27.612 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:27.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:27.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:27.664 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:27.674 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:27.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:27.722 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:27.722 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:27.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:27.748 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:27.748 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:27.780 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:27.780 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:27.780 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:27.780 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:27.805 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:27.805 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:27.805 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:27.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:28.781 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:28.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:28.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:28.881 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:28.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:28.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:28.933 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:28.943 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:28.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:28.992 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:28.992 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:29.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:29.022 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:29.022 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:29.049 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:29.050 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:29.050 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:29.050 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:29.079 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:29.080 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:29.080 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:29.080 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:30.052 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:30.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:30.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:30.150 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:30.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:30.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:30.202 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:30.212 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:30.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:30.259 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:30.259 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:30.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:30.292 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:30.292 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:30.316 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:30.316 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:30.316 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:30.316 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:30.348 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:30.348 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:30.348 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:30.348 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:31.317 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:31.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:31.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:31.415 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:31.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:31.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:31.476 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:31.487 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:31.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:31.494 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:31.494 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:31.551 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:31.551 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:31.551 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:31.551 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:31.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:31.577 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:31.577 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:31.634 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:31.635 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:31.635 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:31.635 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:32.552 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:32.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:32.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:32.650 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:32.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:32.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:32.702 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:32.713 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:32.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:32.720 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:32.720 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:32.777 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:32.777 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:32.777 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:32.777 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:32.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:32.796 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:32.796 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:32.853 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:32.854 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:32.854 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:32.854 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:33.778 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:33.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:33.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:33.876 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:33.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:33.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:33.929 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:33.939 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:33.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:33.986 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:33.986 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:34.025 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:34.025 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:34.026 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:34.043 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:34.043 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:34.043 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:34.043 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:34.082 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:34.083 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:34.083 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:34.083 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:35.044 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:35.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:35.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:35.142 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:35.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:35.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:35.192 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:35.203 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:35.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:35.252 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:35.252 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:35.287 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:35.287 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:35.287 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:35.309 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:35.310 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:35.310 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:35.310 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:35.345 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:35.345 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:35.345 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:35.346 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:36.310 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:36.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:36.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:36.409 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:36.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:36.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:36.461 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:36.471 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:36.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:36.518 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:36.518 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:36.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:36.550 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:36.550 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:36.575 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:36.575 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:36.575 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:36.575 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:36.607 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:36.607 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:36.607 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:36.607 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:37.576 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:37.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:37.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:37.675 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:37.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:37.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:37.728 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:37.738 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:37.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:37.787 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:37.787 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:37.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:37.830 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:37.830 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:37.844 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:37.844 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:37.845 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:37.845 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:37.887 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:37.887 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:37.888 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:37.888 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:38.845 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:38.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:38.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:38.947 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:38.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:38.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:39.000 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:39.010 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:39.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:39.060 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:39.060 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:39.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:39.087 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:39.088 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:39.117 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:39.117 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:39.117 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:39.117 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:39.144 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:39.144 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:39.144 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:39.144 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:40.118 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:40.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:40.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:40.218 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:40.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:40.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:40.270 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:40.280 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:40.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:40.328 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:40.328 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:40.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:40.364 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:40.364 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:40.385 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:40.385 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:40.385 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:40.385 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:40.420 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:40.420 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:40.420 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:40.420 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:41.386 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:41.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:41.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:41.484 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:41.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:41.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:41.535 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:41.545 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:41.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:41.594 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:41.594 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:41.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:41.628 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:41.628 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:41.651 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:41.651 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:41.651 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:41.651 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:41.685 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:41.685 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:41.685 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:41.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:42.652 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:42.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:42.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:42.751 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:42.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:42.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:42.802 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:42.812 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:42.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:42.862 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:42.862 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:42.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:42.903 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:42.903 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:42.920 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:42.920 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:42.920 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:42.920 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:42.960 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:42.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:42.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:42.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:43.921 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:43.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:43.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:44.021 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:44.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:44.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:44.074 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:44.084 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:44.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:44.133 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:44.134 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:44.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:44.172 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:44.172 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:44.190 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:44.191 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:44.191 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:44.191 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:44.229 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:44.230 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:44.230 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:44.230 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:45.192 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:45.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:45.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:45.293 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:45.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:45.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:45.345 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:45.355 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:45.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:45.402 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:45.402 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:45.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:45.434 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:45.434 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:45.459 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:45.459 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:45.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:45.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:45.491 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:45.491 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:45.491 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:45.491 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:46.460 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:46.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:46.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:46.559 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:46.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:46.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:46.611 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:46.621 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:46.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:46.669 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:46.669 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:46.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:46.710 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:46.711 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:46.726 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:46.726 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:46.726 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:46.726 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:46.767 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:46.768 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:46.768 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:46.768 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:47.727 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:47.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:47.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:47.827 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:47.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:47.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:47.879 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:47.889 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:47.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:47.938 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:47.938 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:47.965 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:47.965 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:47.965 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:47.996 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:47.997 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:47.997 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:47.997 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:48.023 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:48.024 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:48.024 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:48.024 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:48.998 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:48.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:48.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:49.097 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:49.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:49.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:49.150 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:49.159 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:49.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:49.209 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:49.209 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:49.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:49.239 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:49.239 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:49.265 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:49.265 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:49.265 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:49.265 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:49.296 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:49.297 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:49.297 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:49.297 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:50.266 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:50.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:50.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:50.364 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:50.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:50.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:50.416 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:50.426 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:50.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:50.475 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:50.475 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:50.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:50.504 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:50.504 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:50.531 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:50.532 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:50.532 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:50.532 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:50.561 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:50.561 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:50.561 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:50.561 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:51.532 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:51.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:51.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:51.631 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:51.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:51.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:51.683 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:51.693 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:51.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:51.742 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:51.742 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:51.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:51.777 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:51.777 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:51.798 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:51.798 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:51.798 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:51.799 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:51.834 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:51.834 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:51.835 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:51.835 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:52.800 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:52.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:52.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:52.898 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:52.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:52.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:52.950 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:52.960 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:53.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:53.009 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:53.009 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:53.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:53.034 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:53.034 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:53.066 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:53.067 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:53.067 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:53.067 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:53.091 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:53.091 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:53.092 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:53.092 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:54.068 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:54.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:54.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:54.166 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:54.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:54.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:54.219 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:54.229 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:54.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:54.236 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:54.236 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:54.293 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:54.293 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:54.293 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:54.293 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:54.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:54.307 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:54.307 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:54.364 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:54.365 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:54.365 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:54.365 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:55.295 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:55.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:55.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:55.394 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:55.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:55.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:55.446 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:55.456 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:55.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:55.464 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:55.464 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:55.521 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:55.521 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:55.521 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:55.521 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:55.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:55.539 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:55.539 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:55.596 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:55.596 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:55.596 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:55.597 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:56.522 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:56.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:56.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:56.622 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:56.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:56.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:56.674 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:56.684 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:56.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:56.730 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:56.731 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:56.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:56.762 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:56.762 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:56.788 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:56.788 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:56.788 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:56.788 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:56.819 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:56.820 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:56.820 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:56.820 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:57.790 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:57.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:57.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:57.889 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:57.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:57.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:57.941 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:57.951 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:57.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:57.999 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:57.999 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:58.026 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:58.027 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:58.027 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:58.057 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:58.057 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:58.057 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:58.057 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:58.084 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:58.084 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:58.084 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:58.084 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:59.058 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:00:59.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:59.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:59.157 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:00:59.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:59.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:00:59.208 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:00:59.219 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:00:59.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:00:59.269 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:59.269 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:00:59.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:00:59.291 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:00:59.291 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:00:59.327 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:59.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:59.327 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:59.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:00:59.349 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:00:59.349 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:00:59.349 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:00:59.350 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:00.329 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:00.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:00.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:00.386 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:00.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:00.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:00.437 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:00.447 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:00.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:00.496 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:00.496 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:00.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:00.536 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:00.536 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:00.554 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:00.554 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:00.554 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:00.554 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:00.593 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:00.594 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:00.594 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:00.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:01.555 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:01.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:01.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:01.653 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:01.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:01.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:01.705 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:01.715 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:01.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:01.764 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:01.764 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:01.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:01.787 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:01.787 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:01.821 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:01.821 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:01.821 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:01.821 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:01.843 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:01.844 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:01.844 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:01.844 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:02.822 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:02.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:02.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:02.920 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:02.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:02.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:02.973 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:02.983 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:03.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:03.032 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:03.032 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:03.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:03.052 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:03.052 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:03.089 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:03.090 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:03.090 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:03.090 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:03.110 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:03.110 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:03.110 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:03.110 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:04.091 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:04.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:04.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:04.190 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:04.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:04.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:04.242 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:04.252 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:04.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:04.302 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:04.302 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:04.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:04.326 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:04.326 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:04.359 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:04.359 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:04.359 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:04.359 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:04.384 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:04.384 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:04.384 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:04.384 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:05.361 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:05.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:05.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:05.458 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:05.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:05.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:05.510 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:05.520 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:05.528 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:05.528 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:05.528 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:05.585 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:05.585 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:05.585 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:05.585 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:05.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:05.603 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:05.603 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:05.659 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:05.660 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:05.660 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:05.660 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:06.586 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:06.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:06.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:06.674 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:06.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:06.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:06.726 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:06.736 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:06.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:06.785 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:06.785 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:06.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:06.809 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:06.809 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:06.842 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:06.842 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:06.842 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:06.842 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:06.865 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:06.866 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:06.866 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:06.866 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:07.843 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:07.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:07.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:07.941 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:07.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:07.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:07.993 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:08.003 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:08.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:08.051 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:08.051 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:08.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:08.086 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:08.086 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:08.108 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:08.108 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:08.108 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:08.108 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:08.142 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:08.143 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:08.143 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:08.143 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:09.109 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:09.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:09.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:09.207 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:09.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:09.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:09.260 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:09.270 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:09.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:09.318 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:09.318 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:09.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:09.346 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:09.347 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:09.375 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:09.376 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:09.376 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:09.376 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:09.403 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:09.403 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:09.403 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:09.403 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:10.377 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:10.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:10.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:10.476 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:10.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:10.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:10.528 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:10.538 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:10.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:10.587 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:10.587 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:10.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:10.625 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:10.626 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:10.645 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:10.645 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:10.645 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:10.645 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:10.682 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:10.682 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:10.682 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:10.682 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:11.646 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:11.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:11.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:11.746 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:11.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:11.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:11.799 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:11.809 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:11.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:11.858 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:11.858 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:11.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:11.885 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:11.885 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:11.916 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:11.916 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:11.916 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:11.916 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:11.942 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:11.942 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:11.942 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:11.943 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:12.917 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:12.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:12.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:13.015 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:13.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:13.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:13.068 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:13.078 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:13.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:13.085 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:13.085 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:13.142 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:13.142 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:13.142 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:13.143 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:13.151 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:13.151 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:13.151 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:13.208 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:13.209 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:13.209 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:13.209 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:14.143 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:14.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:14.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:14.242 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:14.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:14.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:14.295 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:14.305 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:14.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:14.354 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:14.354 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:14.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:14.396 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:14.396 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:14.410 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:14.410 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:14.410 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:14.410 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:14.454 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:14.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:14.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:14.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:15.412 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:15.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:15.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:15.512 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:15.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:15.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:15.565 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:15.575 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:15.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:15.583 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:15.583 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:15.640 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:15.640 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:15.640 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:15.640 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:15.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:15.652 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:15.652 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:15.709 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:15.709 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:15.709 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:15.709 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:16.641 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:16.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:16.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:16.739 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:16.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:16.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:16.791 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:16.801 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:16.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:16.850 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:16.850 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:16.887 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:16.887 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:16.887 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:16.908 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:16.908 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:16.908 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:16.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:16.944 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:16.944 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:16.944 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:16.945 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:17.909 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:17.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:17.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:18.005 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:18.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:18.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:18.066 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:18.076 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:18.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:18.084 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:18.084 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:18.140 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:18.140 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:18.140 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:18.140 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:18.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:18.158 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:18.158 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:18.215 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:18.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:18.216 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:18.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:19.141 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:19.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:19.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:19.240 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:19.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:19.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:19.292 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:19.302 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:19.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:19.352 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:19.352 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:19.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:19.383 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:19.383 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:19.409 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:19.409 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:19.410 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:19.410 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:19.440 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:19.440 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:19.440 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:19.440 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:20.410 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:20.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:20.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:20.510 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:20.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:20.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:20.562 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:20.572 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:20.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:20.620 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:20.621 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:20.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:20.658 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:20.658 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:20.677 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:20.677 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:20.677 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:20.677 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:20.715 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:20.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:20.716 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:20.716 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:21.678 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:21.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:21.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:21.778 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:21.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:21.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:21.830 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:21.841 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:21.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:21.891 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:21.891 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:21.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:21.918 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:21.919 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:21.947 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:21.948 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:21.948 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:21.948 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:21.975 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:21.976 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:21.976 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:21.976 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:22.949 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:22.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:22.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:23.049 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:23.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:23.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:23.102 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:23.112 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:23.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:23.161 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:23.161 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:23.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:23.200 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:23.200 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:23.218 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:23.218 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:23.218 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:23.218 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:23.257 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:23.258 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:23.258 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:23.258 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:24.219 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:24.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:24.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:24.319 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:24.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:24.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:24.372 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:24.382 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:24.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:24.432 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:24.432 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:24.459 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:24.459 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:24.459 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:24.489 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:24.489 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:24.489 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:24.489 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:24.516 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:24.516 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:24.516 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:24.516 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:25.491 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:25.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:25.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:25.591 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:25.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:25.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:25.644 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:25.654 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:25.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:25.663 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:25.663 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:25.719 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:25.719 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:25.720 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:25.720 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:25.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:25.744 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:25.744 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:25.801 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:25.801 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:25.801 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:25.801 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:26.721 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:26.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:26.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:26.803 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:26.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:26.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:26.809 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:26.868 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:26.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:26.890 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:26.890 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:26.947 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:26.947 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:26.947 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:26.947 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:26.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:26.954 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:26.954 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:27.011 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:27.012 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:27.012 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:27.012 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:27.948 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:27.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:27.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:28.048 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:28.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:28.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:28.101 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:28.113 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:28.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:28.160 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:28.160 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:28.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:28.191 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:28.192 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:28.216 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:28.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:28.216 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:28.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:28.248 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:28.248 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:28.248 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:28.249 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:29.217 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:29.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:29.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:29.317 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:29.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:29.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:29.370 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:29.380 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:29.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:29.387 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:29.387 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:29.444 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:29.444 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:29.444 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:29.444 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:29.459 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:29.459 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:29.460 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:29.518 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:29.518 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:29.519 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:29.519 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:30.445 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:30.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:30.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:30.543 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:30.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:30.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:30.594 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:30.604 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:30.655 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:30.655 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:30.655 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:30.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:30.679 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:30.679 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:30.712 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:30.712 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:30.712 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:30.712 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:30.736 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:30.736 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:30.736 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:30.736 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:31.713 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:31.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:31.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:31.811 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:31.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:31.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:31.863 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:31.874 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:31.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:31.923 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:31.923 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:31.956 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:31.956 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:31.956 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:31.980 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:31.980 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:31.980 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:31.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:32.013 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:32.013 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:32.013 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:32.013 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:32.982 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:32.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:32.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:33.032 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:33.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:33.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:33.083 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:33.093 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:33.142 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:33.143 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:33.143 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:33.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:33.181 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:33.181 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:33.199 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:33.199 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:33.199 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:33.199 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:33.238 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:33.238 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:33.238 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:33.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:34.199 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:34.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:34.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:34.299 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:34.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:34.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:34.351 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:34.361 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:34.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:34.410 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:34.410 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:34.439 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:34.439 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:34.439 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:34.466 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:34.466 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:34.466 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:34.466 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:34.496 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:34.496 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:34.496 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:34.496 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:35.467 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:35.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:35.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:35.564 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:35.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:35.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:35.616 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:35.626 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:35.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:35.674 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:35.674 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:35.699 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:35.700 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:35.700 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:35.732 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:35.732 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:35.732 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:35.732 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:35.757 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:35.758 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:35.758 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:35.758 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:36.734 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:36.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:36.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:36.833 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:36.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:36.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:36.886 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:36.896 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:36.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:36.945 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:36.945 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:36.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:36.975 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:36.975 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:37.002 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:37.002 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:37.002 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:37.002 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:37.033 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:37.033 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:37.033 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:37.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:38.003 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:38.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:38.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:38.101 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:38.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:38.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:38.153 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:38.163 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:38.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:38.213 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:38.213 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:38.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:38.250 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:38.250 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:38.270 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:38.270 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:38.270 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:38.270 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:38.308 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:38.308 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:38.308 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:38.308 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:39.271 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:39.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:39.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:39.369 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:39.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:39.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:39.422 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:39.432 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:39.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:39.480 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:39.480 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:39.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:39.510 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:39.510 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:39.538 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:39.539 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:39.539 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:39.539 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:39.566 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:39.567 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:39.567 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:39.567 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:40.540 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:40.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:40.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:40.638 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:40.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:40.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:40.691 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:40.701 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:40.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:40.709 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:40.709 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:40.766 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:40.766 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:40.766 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:40.766 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:40.781 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:40.781 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:40.781 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:40.838 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:40.838 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:40.838 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:40.839 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:41.768 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:41.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:41.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:41.867 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:41.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:41.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:41.920 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:41.930 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:41.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:41.980 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:41.980 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:42.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:42.014 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:42.014 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:42.036 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:42.037 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:42.037 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:42.037 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:42.071 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:42.071 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:42.071 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:42.071 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:43.038 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:43.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:43.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:43.124 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:43.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:43.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:43.175 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:43.185 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:43.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:43.234 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:43.234 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:43.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:43.271 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:43.271 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:43.290 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:43.291 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:43.291 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:43.291 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:43.328 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:43.329 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:43.329 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:43.329 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:44.292 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:44.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:44.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:44.390 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:44.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:44.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:44.441 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:44.451 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:44.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:44.501 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:44.501 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:44.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:44.530 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:44.530 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:44.557 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:44.558 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:44.558 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:44.558 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:44.587 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:44.588 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:44.588 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:44.588 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:45.559 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:45.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:45.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:45.658 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:45.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:45.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:45.710 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:45.720 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:45.769 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:45.769 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:45.770 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:45.807 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:45.807 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:45.807 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:45.826 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:45.827 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:45.827 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:45.827 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:45.865 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:45.865 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:45.865 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:45.865 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:46.827 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:46.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:46.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:46.928 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:46.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:46.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:46.989 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:46.999 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:47.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:47.007 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:47.007 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:47.063 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:47.063 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:47.063 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:47.063 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:47.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:47.081 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:47.081 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:47.138 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:47.138 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:47.139 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:47.139 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:48.064 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:48.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:48.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:48.163 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:48.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:48.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:48.216 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:48.226 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:48.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:48.273 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:48.273 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:48.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:48.311 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:48.311 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:48.329 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:48.330 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:48.330 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:48.330 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:48.369 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:48.369 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:48.369 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:48.369 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:49.331 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:49.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:49.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:49.429 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:49.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:49.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:49.481 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:49.492 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:49.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:49.542 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:49.542 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:49.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:49.563 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:49.563 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:49.600 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:49.600 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.600 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:49.600 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:49.620 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:49.621 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.621 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:49.621 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:50.602 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:50.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:50.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:50.701 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:50.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:50.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:50.753 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:50.763 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:50.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:50.813 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:50.813 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:50.844 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:50.844 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:50.844 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:50.870 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:50.871 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:50.871 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:50.871 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:50.901 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:50.901 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:50.901 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:50.901 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:51.871 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:51.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:51.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:51.970 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:51.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:51.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:52.022 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:52.032 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:52.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:52.082 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:52.082 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:52.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:52.114 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:52.114 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:52.139 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:52.139 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:52.139 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:52.139 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:52.171 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:52.171 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:52.172 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:52.172 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:53.140 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:53.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:53.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:53.238 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:53.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:53.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:53.290 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:53.301 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:53.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:53.350 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:53.350 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:53.372 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:53.372 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:53.372 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:53.407 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:53.408 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:53.408 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:53.408 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:53.429 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:53.430 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:53.430 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:53.430 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:54.409 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:54.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:54.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:54.507 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:54.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:54.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:54.561 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:54.570 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:54.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:54.578 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:54.578 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:54.635 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:54.635 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:54.635 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:54.635 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:54.661 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:54.662 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:54.662 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:54.718 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:54.719 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:54.719 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:54.719 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:55.636 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:55.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:55.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:55.735 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:55.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:55.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:55.788 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:55.798 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:55.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:55.847 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:55.847 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:55.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:55.882 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:55.882 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:55.903 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:55.903 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:55.903 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:55.903 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:55.940 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:55.940 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:55.940 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:55.940 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:56.905 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:56.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:56.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:57.004 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:57.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:57.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:57.058 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:57.067 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:57.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:57.116 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:57.116 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:57.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:57.143 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:57.143 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:57.173 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:57.173 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:57.173 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:57.173 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:57.200 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:57.200 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:57.200 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:57.200 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:58.174 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:58.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:58.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:58.272 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:58.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:58.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:58.325 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:58.335 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:58.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:58.384 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:58.384 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:58.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:58.410 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:58.410 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:58.440 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:58.440 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:58.440 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:58.440 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:58.467 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:58.467 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:58.467 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:58.467 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:59.441 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:01:59.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:59.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:59.541 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:01:59.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:59.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:59.596 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:01:59.604 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:01:59.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:01:59.612 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:59.612 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:01:59.668 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:59.668 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:59.669 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:59.669 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:01:59.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:01:59.683 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:01:59.683 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:01:59.740 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:59.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:59.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:01:59.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:00.669 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:00.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:00.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:00.767 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:00.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:00.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:00.820 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:00.830 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:00.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:00.877 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:00.877 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:00.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:00.904 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:00.905 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:00.933 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:00.933 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:00.933 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:00.933 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:00.962 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:00.962 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:00.962 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:00.962 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:01.934 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:01.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:01.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:02.032 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:02.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:02.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:02.084 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:02.094 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:02.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:02.145 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:02.145 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:02.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:02.171 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:02.171 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:02.201 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:02.201 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:02.201 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:02.201 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:02.227 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:02.227 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:02.228 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:02.228 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:03.202 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:03.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:03.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:03.300 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:03.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:03.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:03.352 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:03.363 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:03.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:03.412 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:03.413 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:03.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:03.434 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:03.434 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:03.469 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:03.469 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:03.469 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:03.469 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:03.491 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:03.491 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:03.491 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:03.491 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:04.471 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:04.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:04.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:04.569 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:04.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:04.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:04.621 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:04.631 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:04.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:04.679 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:04.679 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:04.707 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:04.707 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:04.707 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:04.736 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:04.737 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:04.737 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:04.737 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:04.764 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:04.764 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:04.764 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:04.764 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:05.738 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:05.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:05.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:05.837 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:05.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:05.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:05.889 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:05.899 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:05.947 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:05.947 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:05.947 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:05.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:05.980 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:05.980 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:06.004 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:06.004 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:06.004 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:06.004 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:06.037 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:06.037 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:06.038 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:06.038 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:07.005 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:07.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:07.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:07.104 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:07.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:07.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:07.156 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:07.166 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:07.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:07.215 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:07.215 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:07.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:07.246 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:07.246 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:07.271 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:07.271 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:07.271 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:07.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:07.302 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:07.302 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:07.303 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:07.303 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:08.272 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:08.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:08.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:08.371 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:08.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:08.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:08.423 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:08.433 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:08.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:08.482 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:08.482 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:08.511 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:08.511 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:08.511 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:08.538 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:08.538 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:08.538 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:08.538 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:08.568 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:08.568 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:08.568 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:08.568 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:09.540 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:09.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:09.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:09.639 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:09.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:09.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:09.691 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:09.701 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:09.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:09.748 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:09.748 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:09.772 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:09.772 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:09.772 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:09.805 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:09.805 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:09.805 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:09.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:09.829 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:09.829 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:09.829 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:09.829 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:10.806 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:10.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:10.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:10.905 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:10.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:10.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:10.957 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:10.966 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:11.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:11.015 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:11.015 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:11.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:11.038 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:11.038 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:11.072 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:11.072 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:11.072 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:11.073 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:11.095 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:11.095 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:11.095 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:11.095 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:12.073 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:12.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:12.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:12.173 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:12.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:12.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:12.225 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:12.235 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:12.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:12.283 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:12.283 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:12.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:12.309 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:12.309 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:12.340 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:12.340 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:12.340 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:12.340 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:12.366 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:12.366 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:12.366 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:12.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:13.341 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:13.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:13.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:13.439 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:13.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:13.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:13.490 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:13.500 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:13.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:13.549 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:13.549 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:13.584 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:13.585 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:13.585 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:13.607 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:13.607 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:13.607 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:13.607 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:13.642 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:13.642 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:13.642 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:13.642 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:14.608 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:14.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:14.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:14.707 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:14.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:14.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:14.759 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:14.769 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:14.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:14.777 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:14.777 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:14.833 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:14.833 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:14.833 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:14.833 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:14.848 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:14.848 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:14.848 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:14.906 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:14.907 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:14.907 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:14.907 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:15.834 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:15.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:15.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:15.933 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:15.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:15.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:15.985 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:15.995 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:16.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:16.043 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:16.043 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:16.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:16.069 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:16.069 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:16.100 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:16.101 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:16.101 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:16.101 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:16.128 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:16.128 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:16.128 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:16.128 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:17.103 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:17.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:17.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:17.202 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:17.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:17.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:17.253 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:17.263 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:17.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:17.312 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:17.312 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:17.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:17.348 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:17.348 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:17.369 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:17.369 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:17.369 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:17.369 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:17.405 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:17.405 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:17.405 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:17.405 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:18.369 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:18.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:18.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:18.468 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:18.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:18.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:18.520 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:18.530 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:18.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:18.579 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:18.579 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:18.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:18.605 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:18.605 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:18.635 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:18.635 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:18.635 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:18.635 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:18.661 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:18.662 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:18.662 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:18.662 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:19.637 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:19.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:19.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:19.736 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:19.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:19.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:19.787 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:19.798 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:19.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:19.846 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:19.846 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:19.881 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:19.882 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:19.882 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:19.903 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:19.903 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:19.903 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:19.904 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:19.940 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:19.941 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:19.941 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:19.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:20.904 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:20.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:20.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:21.002 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:21.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:21.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:21.054 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:21.064 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:21.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:21.113 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:21.113 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:21.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:21.139 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:21.139 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:21.169 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:21.170 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:21.170 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:21.170 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:21.198 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:21.198 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:21.198 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:21.199 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:22.171 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:22.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:22.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:22.268 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:22.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:22.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:22.320 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:22.330 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:22.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:22.378 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:22.378 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:22.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:22.405 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:22.405 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:22.435 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:22.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:22.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:22.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:22.461 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:22.462 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:22.462 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:22.462 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:23.435 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:23.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:23.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:23.532 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:23.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:23.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:23.585 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:23.595 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:23.644 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:23.645 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:23.645 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:23.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:23.681 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:23.681 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:23.701 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:23.701 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:23.701 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:23.701 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:23.738 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:23.738 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:23.738 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:23.738 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:24.702 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:24.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:24.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:24.801 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:24.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:24.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:24.852 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:24.862 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:24.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:24.910 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:24.910 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:24.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:24.938 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:24.938 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:24.966 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:24.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:24.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:24.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:24.996 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:24.996 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:24.996 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:24.996 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:25.969 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:25.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:25.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:26.067 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:26.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:26.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:26.119 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:26.129 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:26.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:26.178 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:26.179 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:26.216 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:26.216 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:26.216 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:26.235 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:26.236 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:26.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:26.236 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:26.273 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:26.273 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:26.273 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:26.273 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:27.237 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:27.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:27.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:27.336 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:27.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:27.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:27.387 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:27.398 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:27.447 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:27.447 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:27.447 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:27.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:27.472 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:27.472 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:27.503 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:27.503 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:27.503 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:27.503 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:27.530 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:27.530 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:27.530 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:27.530 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:28.503 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:28.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:28.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:28.602 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:28.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:28.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:28.654 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:28.664 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:28.713 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:28.713 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:28.713 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:28.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:28.753 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:28.753 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:28.770 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:28.770 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:28.771 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:28.771 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:28.811 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:28.811 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:28.811 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:28.811 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:29.772 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:29.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:29.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:29.870 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:29.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:29.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:29.922 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:29.932 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:29.981 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:29.982 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:29.982 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:30.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:30.014 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:30.015 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:30.038 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:30.038 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:30.038 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:30.038 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:30.071 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:30.072 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:30.072 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:30.072 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:31.040 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:31.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:31.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:31.139 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:31.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:31.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:31.191 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:31.201 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:31.248 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:31.248 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:31.248 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:31.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:31.283 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:31.283 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:31.305 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:31.305 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:31.305 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:31.305 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:31.341 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:31.342 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:31.342 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:31.342 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:32.306 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:32.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:32.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:32.405 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:32.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:32.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:32.457 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:32.467 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:32.515 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:32.515 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:32.515 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:32.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:32.549 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:32.549 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:32.572 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:32.572 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:32.572 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:32.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:32.607 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:32.607 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:32.607 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:32.607 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:33.573 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:33.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:33.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:33.672 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:33.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:33.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:33.724 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:33.735 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:33.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:33.742 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:33.742 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:33.799 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:33.799 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:33.799 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:33.799 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:33.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:33.809 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:33.809 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:33.866 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:33.866 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:33.866 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:33.866 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:34.800 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:34.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:34.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:34.900 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:34.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:34.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:34.951 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:34.962 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:35.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:35.011 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:35.011 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:35.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:35.043 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:35.043 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:35.067 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:35.067 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:35.067 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:35.067 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:35.100 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:35.100 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:35.100 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:35.100 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:36.068 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:36.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:36.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:36.167 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:36.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:36.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:36.218 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:36.228 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:36.276 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:36.276 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:36.276 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:36.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:36.308 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:36.308 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:36.335 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:36.335 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:36.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:36.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:36.364 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:36.364 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:36.364 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:36.364 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:37.336 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:37.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:37.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:37.435 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:37.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:37.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:37.487 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:37.497 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:37.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:37.546 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:37.546 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:37.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:37.582 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:37.582 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:37.603 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:37.603 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.603 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:37.603 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:37.639 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:37.639 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.639 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:37.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:38.604 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:38.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:38.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:38.702 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:38.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:38.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:38.755 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:38.765 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:38.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:38.815 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:38.815 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:38.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:38.839 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:38.839 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:38.872 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:38.872 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:38.872 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:38.872 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:38.895 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:38.896 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:38.896 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:38.896 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:39.873 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:39.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:39.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:39.972 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:39.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:39.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:40.024 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:40.034 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:40.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:40.082 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:40.083 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:40.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:40.114 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:40.114 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:40.140 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:40.140 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:40.140 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:40.140 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:40.170 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:40.170 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:40.170 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:40.171 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:41.141 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:41.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:41.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:41.243 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:41.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:41.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:41.295 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:41.305 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:41.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:41.354 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:41.354 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:41.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:41.378 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:41.378 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:41.411 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:41.412 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:41.412 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:41.412 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:41.436 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:41.436 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:41.436 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:41.436 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:42.413 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:42.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:42.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:42.510 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:42.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:42.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:42.562 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:42.572 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:42.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:42.621 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:42.621 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:42.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:42.647 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:42.648 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:42.678 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:42.678 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:42.678 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:42.678 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:42.704 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:42.705 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:42.705 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:42.705 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:43.679 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:43.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:43.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:43.777 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:43.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:43.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:43.829 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:43.839 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:43.887 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:43.887 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:43.888 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:43.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:43.918 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:43.918 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:43.944 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:43.945 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:43.945 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:43.945 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:43.975 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:43.975 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:43.975 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:43.975 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:44.946 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:44.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:44.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:45.043 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:45.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:45.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:45.095 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:45.105 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:45.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:45.154 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:45.154 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:45.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:45.186 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:45.186 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:45.210 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:45.210 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:45.210 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:45.210 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:45.242 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:45.242 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:45.242 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:45.242 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:46.210 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:46.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:46.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:46.308 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:46.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:46.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:46.360 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:46.370 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:46.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:46.420 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:46.420 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:46.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:46.451 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:46.451 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:46.477 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:46.477 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:46.477 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:46.477 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:46.508 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:46.508 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:46.508 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:46.508 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:47.478 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:47.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:47.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:47.575 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:47.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:47.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:47.627 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:47.637 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:47.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:47.686 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:47.686 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:47.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:47.710 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:47.710 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:47.742 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:47.742 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:47.742 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:47.742 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:47.767 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:47.768 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:47.768 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:47.768 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:48.743 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:48.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:48.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:48.841 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:48.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:48.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:48.893 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:48.903 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:48.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:48.953 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:48.953 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:48.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:48.986 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:48.987 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:49.010 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:49.011 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:49.011 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:49.011 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:49.043 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:49.043 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:49.043 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:49.043 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:50.012 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:50.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:50.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:50.111 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:50.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:50.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:50.163 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:50.173 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:50.222 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:50.222 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:50.222 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:50.248 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:50.248 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:50.248 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:50.279 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:50.279 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:50.279 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:50.279 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:50.304 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:50.305 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:50.305 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:50.305 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:51.280 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:51.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:51.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:51.378 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:51.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:51.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:51.431 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:51.441 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:51.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:51.489 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:51.490 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:51.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:51.530 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:51.531 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:51.546 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:51.547 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:51.547 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:51.547 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:51.587 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:51.587 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:51.588 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:51.588 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:52.548 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:52.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:52.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:52.648 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:52.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:52.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:52.699 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:52.709 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:52.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:52.758 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:52.758 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:52.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:52.795 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:52.795 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:52.815 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:52.816 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:52.816 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:52.816 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:52.852 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:52.852 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:52.852 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:52.852 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:53.817 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:53.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:53.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:53.935 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:53.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:53.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:54.011 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:54.021 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:54.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:54.028 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:54.028 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:54.085 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:54.085 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:54.085 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:54.085 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:54.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:54.106 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:54.107 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:54.164 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:54.165 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:54.165 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:54.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:55.086 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:55.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:55.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:55.185 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:55.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:55.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:55.237 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:55.247 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:55.296 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:55.296 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:55.296 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:55.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:55.328 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:55.328 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:55.352 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:55.352 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:55.352 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:55.352 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:55.385 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:55.386 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:55.386 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:55.386 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:56.353 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:56.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:56.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:56.451 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:56.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:56.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:56.503 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:56.514 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:56.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:56.563 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:56.563 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:56.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:56.590 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:56.590 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:56.619 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:56.619 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:56.619 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:56.619 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:56.646 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:56.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:56.647 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:56.647 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:57.620 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:57.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:57.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:57.719 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:57.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:57.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:57.771 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:57.781 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:57.830 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:57.830 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:57.830 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:57.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:57.862 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:57.862 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:57.887 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:57.887 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:57.887 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:57.887 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:57.919 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:57.919 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:57.919 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:57.919 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:58.887 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:02:58.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:58.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:58.987 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:02:58.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:58.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:59.038 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:02:59.048 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:02:59.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:02:59.098 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:59.098 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:02:59.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:02:59.133 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:59.133 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:02:59.154 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:59.154 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:59.154 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:59.154 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:59.190 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:59.190 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:59.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:59.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:00.156 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:00.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:00.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:00.255 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:00.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:00.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:00.307 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:00.317 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:00.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:00.367 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:00.367 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:00.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:00.397 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:00.398 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:00.423 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:00.424 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:00.424 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:00.424 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:00.456 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:00.457 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:00.457 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:00.457 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:01.425 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:01.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:01.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:01.522 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:01.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:01.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:01.574 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:01.584 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:01.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:01.632 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:01.632 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:01.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:01.664 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:01.664 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:01.689 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:01.689 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:01.689 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:01.689 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:01.721 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:01.721 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:01.721 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:01.721 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:02.691 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:02.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:02.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:02.792 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:02.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:02.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:02.844 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:02.855 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:02.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:02.903 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:02.903 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:02.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:02.943 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:02.943 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:02.960 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:02.960 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:02.960 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:02.960 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:03.000 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:03.001 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:03.001 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:03.001 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:03.961 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:03.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:03.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:04.060 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:04.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:04.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:04.111 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:04.121 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:04.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:04.170 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:04.170 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:04.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:04.202 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:04.202 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:04.226 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:04.226 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:04.226 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:04.226 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:04.260 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:04.260 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:04.260 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:04.260 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:05.228 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:05.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:05.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:05.326 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:05.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:05.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:05.378 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:05.388 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:05.436 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:05.436 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:05.436 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:05.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:05.477 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:05.477 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:05.494 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:05.494 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:05.494 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:05.494 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:05.534 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:05.534 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:05.534 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:05.534 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:06.495 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:06.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:06.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:06.594 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:06.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:06.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:06.647 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:06.657 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:06.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:06.705 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:06.705 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:06.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:06.745 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:06.745 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:06.762 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:06.762 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:06.762 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:06.762 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:06.803 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:06.803 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:06.803 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:06.803 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:07.763 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:07.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:07.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:07.862 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:07.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:07.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:07.917 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:07.927 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:07.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:07.975 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:07.975 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:08.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:08.006 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:08.006 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:08.031 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:08.031 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:08.031 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:08.031 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:08.063 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:08.063 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:08.063 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:08.063 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:09.032 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:09.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:09.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:09.131 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:09.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:09.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:09.182 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:09.192 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:09.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:09.241 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:09.242 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:09.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:09.278 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:09.278 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:09.298 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:09.298 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:09.298 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:09.298 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:09.335 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:09.335 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:09.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:09.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:10.300 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:10.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:10.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:10.398 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:10.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:10.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:10.453 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:10.463 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:10.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:10.512 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:10.512 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:10.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:10.539 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:10.539 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:10.569 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:10.569 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:10.569 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:10.569 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:10.596 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:10.596 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:10.596 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:10.596 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:11.570 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:11.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:11.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:11.669 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:11.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:11.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:11.721 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:11.731 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:11.780 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:11.780 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:11.780 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:11.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:11.816 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:11.816 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:11.838 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:11.838 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:11.839 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:11.839 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:11.873 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:11.873 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:11.873 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:11.873 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:12.840 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:12.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:12.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:12.938 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:12.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:12.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:12.994 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:13.004 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:13.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:13.052 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:13.052 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:13.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:13.090 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:13.090 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:13.110 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:13.110 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:13.111 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:13.111 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:13.148 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:13.148 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:13.148 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:13.148 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:14.112 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:14.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:14.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:14.211 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:14.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:14.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:14.263 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:14.273 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:14.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:14.321 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:14.322 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:14.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:14.354 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:14.355 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:14.378 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:14.378 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:14.378 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:14.378 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:14.411 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:14.411 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:14.412 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:14.412 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:15.379 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:15.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:15.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:15.477 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:15.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:15.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:15.529 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:15.539 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:15.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:15.587 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:15.587 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:15.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:15.622 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:15.622 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:15.644 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:15.644 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:15.644 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:15.644 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:15.678 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:15.679 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:15.679 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:15.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:16.645 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:16.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:16.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:16.743 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:16.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:16.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:16.795 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:16.805 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:16.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:16.854 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:16.854 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:16.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:16.890 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:16.890 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:16.911 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:16.911 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:16.911 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:16.911 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:16.947 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:16.947 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:16.947 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:16.947 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:17.912 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:17.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:17.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:18.011 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:18.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:18.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:18.064 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:18.074 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:18.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:18.081 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:18.081 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:18.138 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:18.138 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:18.138 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:18.138 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:18.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:18.157 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:18.157 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:18.214 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:18.214 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:18.214 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:18.215 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:19.139 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:19.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:19.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:19.206 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:19.215 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:19.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:19.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:19.281 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:19.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:19.288 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:19.288 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:19.345 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:19.345 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:19.346 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:19.346 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:19.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:19.368 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:19.368 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:19.425 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:19.426 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:19.426 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:19.426 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:20.347 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:20.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:20.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:20.445 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:20.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:20.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:20.497 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:20.507 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:20.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:20.556 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:20.556 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:20.584 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:20.584 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:20.584 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:20.612 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:20.612 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:20.612 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:20.612 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:20.640 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:20.640 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:20.641 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:20.641 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:21.613 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:21.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:21.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:21.713 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:21.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:21.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:21.766 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:21.776 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:21.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:21.825 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:21.825 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:21.857 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:21.857 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:21.857 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:21.882 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:21.882 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:21.882 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:21.882 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:21.914 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:21.914 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:21.915 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:21.915 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:22.882 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:22.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:22.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:22.986 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:22.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:22.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:23.038 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:23.048 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:23.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:23.097 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:23.097 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:23.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:23.123 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:23.123 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:23.154 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:23.154 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:23.155 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:23.155 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:23.180 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:23.181 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:23.181 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:23.181 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:24.156 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:24.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:24.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:24.255 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:24.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:24.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:24.306 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:24.317 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:24.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:24.365 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:24.365 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:24.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:24.399 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:24.399 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:24.423 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:24.423 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:24.423 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:24.423 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:24.456 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:24.457 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:24.457 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:24.457 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:25.424 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:25.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:25.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:25.523 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:25.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:25.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:25.575 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:25.585 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:25.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:25.634 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:25.634 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:25.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:25.667 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:25.667 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:25.690 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:25.690 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:25.690 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:25.690 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:25.724 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:25.724 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:25.724 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:25.724 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:26.691 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:26.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:26.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:26.791 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:26.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:26.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:26.843 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:26.853 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:26.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:26.903 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:26.903 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:26.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:26.928 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:26.928 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:26.961 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:26.962 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:26.962 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:26.962 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:26.985 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:26.985 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:26.985 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:26.985 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:27.963 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:27.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:27.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:28.065 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:28.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:28.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:28.118 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:28.128 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:28.176 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:28.177 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:28.177 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:28.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:28.214 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:28.214 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:28.234 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:28.234 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:28.234 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:28.234 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:28.272 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:28.272 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:28.272 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:28.272 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:29.235 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:29.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:29.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:29.333 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:29.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:29.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:29.383 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:29.393 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:29.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:29.441 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:29.441 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:29.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:29.472 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:29.472 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:29.498 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:29.498 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:29.498 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:29.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:29.529 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:29.529 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:29.529 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:29.529 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:30.500 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:30.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:30.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:30.599 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:30.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:30.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:30.651 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:30.661 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:30.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:30.709 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:30.709 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:30.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:30.742 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:30.742 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:30.766 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:30.766 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:30.766 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:30.767 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:30.799 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:30.799 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:30.799 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:30.799 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:31.768 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:31.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:31.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:31.866 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:31.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:31.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:31.917 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:31.927 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:31.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:31.977 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:31.978 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:31.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:31.999 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:31.999 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:32.034 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:32.035 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:32.035 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:32.035 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:32.057 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:32.057 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:32.057 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:32.057 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:33.036 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:33.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:33.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:33.135 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:33.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:33.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:33.188 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:33.198 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:33.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:33.246 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:33.246 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:33.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:33.280 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:33.280 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:33.303 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:33.303 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:33.303 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:33.303 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:33.337 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:33.338 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:33.338 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:33.338 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:34.304 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:34.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:34.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:34.403 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:34.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:34.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:34.456 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:34.466 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:34.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:34.514 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:34.514 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:34.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:34.548 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:34.548 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:34.571 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:34.571 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:34.571 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:34.571 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:34.606 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:34.606 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:34.606 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:34.606 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:35.573 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:35.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:35.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:35.670 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:35.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:35.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:35.722 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:35.732 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:35.781 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:35.781 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:35.781 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:35.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:35.816 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:35.817 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:35.837 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:35.837 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:35.837 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:35.837 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:35.874 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:35.875 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:35.875 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:35.875 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:36.838 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:36.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:36.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:36.936 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:36.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:36.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:36.989 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:36.999 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:37.047 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:37.047 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:37.047 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:37.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:37.074 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:37.074 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:37.104 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:37.105 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:37.105 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:37.105 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:37.131 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:37.131 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:37.131 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:37.131 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:38.105 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:38.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:38.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:38.204 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:38.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:38.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:38.256 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:38.266 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:38.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:38.314 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:38.315 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:38.342 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:38.342 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:38.342 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:38.372 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:38.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:38.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:38.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:38.401 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:38.401 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:38.401 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:38.401 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:39.373 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:39.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:39.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:39.471 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:39.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:39.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:39.522 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:39.533 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:39.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:39.582 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:39.582 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:39.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:39.613 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:39.613 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:39.638 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:39.638 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:39.638 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:39.638 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:39.670 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:39.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:39.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:39.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:40.639 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:40.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:40.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:40.737 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:40.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:40.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:40.789 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:40.799 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:40.848 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:40.848 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:40.848 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:40.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:40.874 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:40.874 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:40.905 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:40.906 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:40.906 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:40.906 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:40.931 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:40.932 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:40.932 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:40.932 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:41.907 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:41.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:41.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:41.994 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:41.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:41.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:42.047 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:42.057 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:42.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:42.106 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:42.106 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:42.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:42.133 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:42.133 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:42.162 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:42.162 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:42.162 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:42.162 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:42.190 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:42.190 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:42.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:42.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:43.163 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:43.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:43.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:43.262 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:43.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:43.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:43.314 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:43.324 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:43.371 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:43.371 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:43.371 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:43.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:43.410 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:43.410 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:43.427 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:43.427 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:43.427 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:43.427 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:43.467 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:43.467 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:43.467 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:43.467 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:44.428 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:44.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:44.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:44.525 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:44.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:44.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:44.576 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:44.586 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:44.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:44.635 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:44.635 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:44.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:44.668 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:44.668 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:44.692 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:44.692 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:44.692 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:44.692 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:44.726 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:44.726 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:44.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:44.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:45.693 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:45.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:45.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:45.792 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:45.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:45.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:45.857 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:45.865 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:45.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:45.873 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:45.873 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:45.930 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:45.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:45.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:45.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:45.940 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:45.940 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:45.940 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:45.996 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:45.997 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:45.997 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:45.997 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:46.931 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:46.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:46.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:47.030 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:47.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:47.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:47.082 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:47.092 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:47.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:47.140 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:47.141 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:47.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:47.167 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:47.167 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:47.197 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:47.197 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:47.197 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:47.197 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:47.224 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:47.224 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:47.224 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:47.224 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:48.198 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:48.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:48.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:48.250 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:48.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:48.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:48.302 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:48.312 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:48.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:48.359 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:48.359 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:48.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:48.386 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:48.386 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:48.415 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:48.415 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:48.415 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:48.415 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:48.443 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:48.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:48.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:48.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:49.417 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:49.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:49.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:49.515 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:49.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:49.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:49.567 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:49.577 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:49.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:49.625 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:49.626 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:49.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:49.652 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:49.652 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:49.682 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:49.683 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:49.683 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:49.683 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:49.708 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:49.709 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:49.709 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:49.709 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:50.684 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:50.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:50.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:50.783 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:50.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:50.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:50.834 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:50.845 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:50.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:50.894 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:50.894 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:50.915 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:50.915 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:50.915 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:50.950 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:50.950 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:50.950 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:50.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:50.972 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:50.972 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:50.972 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:50.972 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:51.952 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:51.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:51.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:52.049 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:52.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:52.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:52.102 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:52.112 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:52.160 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:52.160 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:52.160 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:52.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:52.197 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:52.198 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:52.217 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:52.218 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:52.218 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:52.218 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:52.255 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:52.256 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:52.256 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:52.256 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:53.218 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:53.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:53.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:53.317 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:53.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:53.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:53.373 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:53.384 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:53.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:53.433 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:53.433 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:53.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:53.460 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:53.460 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:53.490 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:53.490 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:53.490 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:53.490 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:53.517 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:53.517 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:53.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:53.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:54.491 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:54.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:54.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:54.590 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:54.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:54.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:54.641 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:54.652 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:54.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:54.700 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:54.700 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:54.728 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:54.728 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:54.728 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:54.757 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:54.757 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:54.757 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:54.757 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:54.785 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:54.785 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:54.785 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:54.785 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:55.759 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:03:55.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:55.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:55.856 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:03:55.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:55.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:55.908 DEBUG:teuthology.orchestra.run.trial164:> true 2026-02-12T22:03:55.918 DEBUG:teuthology.orchestra.run.trial020:> true 2026-02-12T22:03:55.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com' 2026-02-12T22:03:55.967 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:55.968 DEBUG:teuthology.orchestra.run.trial164:> uname -r 2026-02-12T22:03:55.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com' 2026-02-12T22:03:55.993 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:55.993 DEBUG:teuthology.orchestra.run.trial020:> uname -r 2026-02-12T22:03:56.023 INFO:teuthology.orchestra.run.trial164.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:56.023 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:56.024 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:56.024 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:56.024 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:56.026 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:03:56.039 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:03:56.071 INFO:teuthology.run:Summary data: description: fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/workunit/quota} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:03:56.072 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:03:56.152 INFO:teuthology.orchestra.run.trial020.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:56.152 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:56.152 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:56.152 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:56.185 INFO:teuthology.run:FAIL