2026-02-12T22:45:42.966 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:45:42.982 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:45:43.061 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47283 branch: wip-pdonnell-testing-20260210.171210 description: fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/truncate_delay} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47283' kernel: client: sha1: distro sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_oc_max_dirty_age: 1 ms_inject_delay_max: 5 ms_inject_delay_probability: 1 ms_inject_delay_type: osd pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: syntax: v1 selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHR0xEV56Yalj061zn69577cgmU/cF8r4eT0FoG35lE5UR3SrQMvAfQFd2zWaWd5tiBXkF9D/9xHYqV27TlGpd4= trial158.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN3wzZ+oX/4FAXsNtHJFRdthSxrxOmgJWOtdAdQ8FuEFZ6QrDnqp238i/df0SvYoOpTQs3jvA0A1A4zSXaR7oPU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - exec: client.0: - cd $TESTDIR/mnt.0 && dd if=/dev/zero of=./foo count=100 - sleep 2 - cd $TESTDIR/mnt.0 && truncate --size 0 ./foo teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:45:43.062 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:45:43.062 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:45:43.062 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:45:43.063 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:45:43.064 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:45:43.064 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:45:43.064 INFO:teuthology.packaging:ref: None 2026-02-12T22:45:43.064 INFO:teuthology.packaging:tag: None 2026-02-12T22:45:43.064 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:45:43.064 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:45:43.064 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:45:43.183 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:45:43.184 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:45:43.196 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:45:43.196 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:45:43.210 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:45:43.229 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:45:43.240 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:45:43.323 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial138.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47283', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:42:24.244359', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHR0xEV56Yalj061zn69577cgmU/cF8r4eT0FoG35lE5UR3SrQMvAfQFd2zWaWd5tiBXkF9D/9xHYqV27TlGpd4='} 2026-02-12T22:45:43.381 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial158.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47283', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:42:24.244928', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN3wzZ+oX/4FAXsNtHJFRdthSxrxOmgJWOtdAdQ8FuEFZ6QrDnqp238i/df0SvYoOpTQs3jvA0A1A4zSXaR7oPU='} 2026-02-12T22:45:43.381 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:45:43.393 INFO:teuthology.task.internal:roles: ubuntu@trial138.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2026-02-12T22:45:43.393 INFO:teuthology.task.internal:roles: ubuntu@trial158.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2026-02-12T22:45:43.393 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:45:43.529 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7d2f8d9f49a0>, signals=[15]) 2026-02-12T22:45:43.529 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:45:43.542 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:45:43.542 DEBUG:teuthology.task.internal:connecting to ubuntu@trial138.front.sepia.ceph.com 2026-02-12T22:45:43.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:43.604 DEBUG:teuthology.task.internal:connecting to ubuntu@trial158.front.sepia.ceph.com 2026-02-12T22:45:43.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:43.664 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:45:43.676 DEBUG:teuthology.orchestra.run.trial138:> uname -m 2026-02-12T22:45:43.692 INFO:teuthology.orchestra.run.trial138.stdout:x86_64 2026-02-12T22:45:43.693 DEBUG:teuthology.orchestra.run.trial138:> cat /etc/os-release 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:NAME="Rocky Linux" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:ID="rocky" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:VERSION_ID="10.1" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:ANSI_COLOR="0;32" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:VENDOR_NAME="RESF" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:45:43.750 INFO:teuthology.orchestra.run.trial138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:45:43.751 INFO:teuthology.lock.ops:Updating trial138.front.sepia.ceph.com on lock server 2026-02-12T22:45:43.822 DEBUG:teuthology.orchestra.run.trial158:> uname -m 2026-02-12T22:45:43.839 INFO:teuthology.orchestra.run.trial158.stdout:x86_64 2026-02-12T22:45:43.839 DEBUG:teuthology.orchestra.run.trial158:> cat /etc/os-release 2026-02-12T22:45:43.896 INFO:teuthology.orchestra.run.trial158.stdout:NAME="Rocky Linux" 2026-02-12T22:45:43.896 INFO:teuthology.orchestra.run.trial158.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:45:43.896 INFO:teuthology.orchestra.run.trial158.stdout:ID="rocky" 2026-02-12T22:45:43.896 INFO:teuthology.orchestra.run.trial158.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:45:43.896 INFO:teuthology.orchestra.run.trial158.stdout:VERSION_ID="10.1" 2026-02-12T22:45:43.896 INFO:teuthology.orchestra.run.trial158.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:45:43.896 INFO:teuthology.orchestra.run.trial158.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:45:43.896 INFO:teuthology.orchestra.run.trial158.stdout:ANSI_COLOR="0;32" 2026-02-12T22:45:43.896 INFO:teuthology.orchestra.run.trial158.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:45:43.897 INFO:teuthology.orchestra.run.trial158.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:45:43.897 INFO:teuthology.orchestra.run.trial158.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:45:43.897 INFO:teuthology.orchestra.run.trial158.stdout:VENDOR_NAME="RESF" 2026-02-12T22:45:43.897 INFO:teuthology.orchestra.run.trial158.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:45:43.897 INFO:teuthology.orchestra.run.trial158.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:45:43.897 INFO:teuthology.orchestra.run.trial158.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:45:43.897 INFO:teuthology.orchestra.run.trial158.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:45:43.897 INFO:teuthology.orchestra.run.trial158.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:45:43.897 INFO:teuthology.orchestra.run.trial158.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:45:43.897 INFO:teuthology.orchestra.run.trial158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:45:43.897 INFO:teuthology.lock.ops:Updating trial158.front.sepia.ceph.com on lock server 2026-02-12T22:45:43.977 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:45:43.989 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:45:44.001 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:45:44.001 DEBUG:teuthology.orchestra.run.trial138:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:45:44.003 DEBUG:teuthology.orchestra.run.trial158:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:45:44.020 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:45:44.031 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:45:44.031 DEBUG:teuthology.orchestra.run.trial138:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:45:44.061 DEBUG:teuthology.orchestra.run.trial158:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:45:44.076 INFO:teuthology.orchestra.run.trial138.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:45:44.078 INFO:teuthology.orchestra.run.trial158.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:45:44.079 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:45:44.240 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:45:44.261 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'sha1': 'distro'} 2026-02-12T22:45:44.261 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2026-02-12T22:45:44.261 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:45:44.261 DEBUG:teuthology.orchestra.run.trial138:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:45:44.261 DEBUG:teuthology.orchestra.run.trial158:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:45:44.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:45:44.277 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:45:44.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:45:44.279 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:45:44.334 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:44.334 INFO:teuthology.task.kernel:Running kernel on trial158: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:44.335 DEBUG:teuthology.orchestra.run.trial158:> sudo yum install -y kernel 2026-02-12T22:45:44.335 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:44.335 INFO:teuthology.task.kernel:Running kernel on trial138: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:44.336 DEBUG:teuthology.orchestra.run.trial138:> sudo yum install -y kernel 2026-02-12T22:45:44.833 INFO:teuthology.orchestra.run.trial138.stdout:Rocky Linux 10 - AppStream 22 MB/s | 2.2 MB 00:00 2026-02-12T22:45:44.835 INFO:teuthology.orchestra.run.trial158.stdout:Rocky Linux 10 - AppStream 23 MB/s | 2.2 MB 00:00 2026-02-12T22:45:45.177 INFO:teuthology.orchestra.run.trial138.stdout:Rocky Linux 10 - BaseOS 50 MB/s | 11 MB 00:00 2026-02-12T22:45:45.211 INFO:teuthology.orchestra.run.trial158.stdout:Rocky Linux 10 - BaseOS 43 MB/s | 11 MB 00:00 2026-02-12T22:45:45.657 INFO:teuthology.orchestra.run.trial138.stdout:Rocky Linux 10 - CRB 7.2 MB/s | 507 kB 00:00 2026-02-12T22:45:45.691 INFO:teuthology.orchestra.run.trial158.stdout:Rocky Linux 10 - CRB 6.7 MB/s | 507 kB 00:00 2026-02-12T22:45:46.115 INFO:teuthology.orchestra.run.trial158.stdout:Extra Packages for Enterprise Linux 17 MB/s | 6.2 MB 00:00 2026-02-12T22:45:46.422 INFO:teuthology.orchestra.run.trial138.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 6.2 MB 00:00 2026-02-12T22:45:46.767 INFO:teuthology.orchestra.run.trial158.stdout:lab-extras 308 kB/s | 3.7 kB 00:00 2026-02-12T22:45:47.075 INFO:teuthology.orchestra.run.trial138.stdout:lab-extras 296 kB/s | 3.7 kB 00:00 2026-02-12T22:45:47.174 INFO:teuthology.orchestra.run.trial158.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:45:47.186 INFO:teuthology.orchestra.run.trial158.stdout:Dependencies resolved. 2026-02-12T22:45:47.187 INFO:teuthology.orchestra.run.trial158.stdout:================================================================================ 2026-02-12T22:45:47.188 INFO:teuthology.orchestra.run.trial158.stdout: Package Arch Version Repo Size 2026-02-12T22:45:47.188 INFO:teuthology.orchestra.run.trial158.stdout:================================================================================ 2026-02-12T22:45:47.188 INFO:teuthology.orchestra.run.trial158.stdout:Installing: 2026-02-12T22:45:47.188 INFO:teuthology.orchestra.run.trial158.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:45:47.188 INFO:teuthology.orchestra.run.trial158.stdout:Installing dependencies: 2026-02-12T22:45:47.188 INFO:teuthology.orchestra.run.trial158.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:45:47.188 INFO:teuthology.orchestra.run.trial158.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:45:47.188 INFO:teuthology.orchestra.run.trial158.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:45:47.188 INFO:teuthology.orchestra.run.trial158.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:45:47.188 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-12T22:45:47.188 INFO:teuthology.orchestra.run.trial158.stdout:Transaction Summary 2026-02-12T22:45:47.189 INFO:teuthology.orchestra.run.trial158.stdout:================================================================================ 2026-02-12T22:45:47.189 INFO:teuthology.orchestra.run.trial158.stdout:Install 5 Packages 2026-02-12T22:45:47.189 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-12T22:45:47.189 INFO:teuthology.orchestra.run.trial158.stdout:Total download size: 93 M 2026-02-12T22:45:47.189 INFO:teuthology.orchestra.run.trial158.stdout:Installed size: 135 M 2026-02-12T22:45:47.189 INFO:teuthology.orchestra.run.trial158.stdout:Downloading Packages: 2026-02-12T22:45:47.248 INFO:teuthology.orchestra.run.trial158.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2026-02-12T22:45:47.456 INFO:teuthology.orchestra.run.trial158.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 69 MB/s | 18 MB 00:00 2026-02-12T22:45:47.485 INFO:teuthology.orchestra.run.trial138.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:45:47.497 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-12T22:45:47.497 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-12T22:45:47.497 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-12T22:45:47.497 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-12T22:45:47.497 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-12T22:45:47.497 INFO:teuthology.orchestra.run.trial138.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:45:47.497 INFO:teuthology.orchestra.run.trial138.stdout:Installing dependencies: 2026-02-12T22:45:47.497 INFO:teuthology.orchestra.run.trial138.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:45:47.498 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:45:47.498 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:45:47.498 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:45:47.498 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-12T22:45:47.498 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-12T22:45:47.498 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-12T22:45:47.498 INFO:teuthology.orchestra.run.trial138.stdout:Install 5 Packages 2026-02-12T22:45:47.498 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-12T22:45:47.498 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 93 M 2026-02-12T22:45:47.498 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 135 M 2026-02-12T22:45:47.498 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-12T22:45:47.520 INFO:teuthology.orchestra.run.trial158.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 44 MB/s | 2.8 MB 00:00 2026-02-12T22:45:47.553 INFO:teuthology.orchestra.run.trial138.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 25 MB/s | 1.4 MB 00:00 2026-02-12T22:45:47.631 INFO:teuthology.orchestra.run.trial158.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 77 MB/s | 30 MB 00:00 2026-02-12T22:45:47.814 INFO:teuthology.orchestra.run.trial138.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 58 MB/s | 18 MB 00:00 2026-02-12T22:45:47.841 INFO:teuthology.orchestra.run.trial158.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 62 MB/s | 41 MB 00:00 2026-02-12T22:45:47.842 INFO:teuthology.orchestra.run.trial158.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:45:47.843 INFO:teuthology.orchestra.run.trial158.stdout:Total 142 MB/s | 93 MB 00:00 2026-02-12T22:45:47.843 INFO:teuthology.orchestra.run.trial158.stdout:Running transaction check 2026-02-12T22:45:47.875 INFO:teuthology.orchestra.run.trial138.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 46 MB/s | 2.8 MB 00:00 2026-02-12T22:45:47.986 INFO:teuthology.orchestra.run.trial158.stdout:Transaction check succeeded. 2026-02-12T22:45:47.986 INFO:teuthology.orchestra.run.trial158.stdout:Running transaction test 2026-02-12T22:45:48.007 INFO:teuthology.orchestra.run.trial138.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 65 MB/s | 30 MB 00:00 2026-02-12T22:45:48.068 INFO:teuthology.orchestra.run.trial138.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 71 MB/s | 41 MB 00:00 2026-02-12T22:45:48.068 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:45:48.069 INFO:teuthology.orchestra.run.trial138.stdout:Total 163 MB/s | 93 MB 00:00 2026-02-12T22:45:48.069 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-12T22:45:48.214 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-12T22:45:48.214 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-12T22:45:48.387 INFO:teuthology.orchestra.run.trial158.stdout:Transaction test succeeded. 2026-02-12T22:45:48.387 INFO:teuthology.orchestra.run.trial158.stdout:Running transaction 2026-02-12T22:45:48.615 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-12T22:45:48.615 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-12T22:45:49.080 INFO:teuthology.orchestra.run.trial158.stdout: Preparing : 1/1 2026-02-12T22:45:49.281 INFO:teuthology.orchestra.run.trial158.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:45:49.302 INFO:teuthology.orchestra.run.trial158.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:45:49.310 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-12T22:45:49.512 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:45:49.533 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:45:50.562 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:45:50.589 INFO:teuthology.orchestra.run.trial158.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:45:50.783 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:45:50.811 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:45:52.437 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:45:52.442 INFO:teuthology.orchestra.run.trial158.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:45:52.660 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:45:52.665 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:45:54.299 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:45:54.309 INFO:teuthology.orchestra.run.trial158.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:45:54.526 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:45:54.536 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:45:56.172 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:45:56.398 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:46:29.914 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:46:29.937 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:46:29.977 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:46:29.998 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:46:30.170 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:46:30.170 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-12T22:46:30.170 INFO:teuthology.orchestra.run.trial158.stdout:Installed: 2026-02-12T22:46:30.170 INFO:teuthology.orchestra.run.trial158.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.170 INFO:teuthology.orchestra.run.trial158.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.170 INFO:teuthology.orchestra.run.trial158.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.170 INFO:teuthology.orchestra.run.trial158.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.170 INFO:teuthology.orchestra.run.trial158.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.170 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-12T22:46:30.171 INFO:teuthology.orchestra.run.trial158.stdout:Complete! 2026-02-12T22:46:30.231 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:46:30.231 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-12T22:46:30.231 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-12T22:46:30.231 INFO:teuthology.orchestra.run.trial138.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.231 INFO:teuthology.orchestra.run.trial138.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.231 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.231 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.232 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.232 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-12T22:46:30.232 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-12T22:46:30.233 DEBUG:teuthology.orchestra.run.trial158:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:46:30.267 INFO:teuthology.orchestra.run.trial158.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.268 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.268 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.268 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:46:30.268 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:46:30.268 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2026-02-12T22:46:30.269 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial158.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:46:30.269 DEBUG:teuthology.orchestra.run.trial158:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:46:30.292 DEBUG:teuthology.orchestra.run.trial138:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:46:30.341 INFO:teuthology.orchestra.run.trial158.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.343 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.343 DEBUG:teuthology.orchestra.run.trial158:> sudo rpm -qi grub2-tools 2026-02-12T22:46:30.367 INFO:teuthology.orchestra.run.trial138.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.368 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.368 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.368 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:46:30.368 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:46:30.369 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2026-02-12T22:46:30.369 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial138.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:46:30.369 DEBUG:teuthology.orchestra.run.trial138:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:46:30.414 INFO:teuthology.orchestra.run.trial158.stdout:Name : grub2-tools 2026-02-12T22:46:30.414 INFO:teuthology.orchestra.run.trial158.stdout:Epoch : 1 2026-02-12T22:46:30.414 INFO:teuthology.orchestra.run.trial158.stdout:Version : 2.12 2026-02-12T22:46:30.415 INFO:teuthology.orchestra.run.trial158.stdout:Release : 29.el10_1 2026-02-12T22:46:30.415 INFO:teuthology.orchestra.run.trial158.stdout:Architecture: x86_64 2026-02-12T22:46:30.415 INFO:teuthology.orchestra.run.trial158.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:46:30.415 INFO:teuthology.orchestra.run.trial158.stdout:Group : Unspecified 2026-02-12T22:46:30.415 INFO:teuthology.orchestra.run.trial158.stdout:Size : 7963769 2026-02-12T22:46:30.415 INFO:teuthology.orchestra.run.trial158.stdout:License : GPL-3.0-or-later 2026-02-12T22:46:30.415 INFO:teuthology.orchestra.run.trial158.stdout:Signature : 2026-02-12T22:46:30.415 INFO:teuthology.orchestra.run.trial158.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:46:30.415 INFO:teuthology.orchestra.run.trial158.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:46:30.415 INFO:teuthology.orchestra.run.trial158.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:46:30.416 INFO:teuthology.orchestra.run.trial158.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:46:30.416 INFO:teuthology.orchestra.run.trial158.stdout:Packager : Release Engineering 2026-02-12T22:46:30.416 INFO:teuthology.orchestra.run.trial158.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:46:30.416 INFO:teuthology.orchestra.run.trial158.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:46:30.416 INFO:teuthology.orchestra.run.trial158.stdout:Summary : Support tools for GRUB. 2026-02-12T22:46:30.416 INFO:teuthology.orchestra.run.trial158.stdout:Description : 2026-02-12T22:46:30.416 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-12T22:46:30.416 INFO:teuthology.orchestra.run.trial158.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:46:30.416 INFO:teuthology.orchestra.run.trial158.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:46:30.416 INFO:teuthology.orchestra.run.trial158.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:46:30.417 INFO:teuthology.orchestra.run.trial158.stdout:hardware devices. 2026-02-12T22:46:30.417 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-12T22:46:30.417 INFO:teuthology.orchestra.run.trial158.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:46:30.418 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:46:30.418 INFO:teuthology.task.kernel:Updating grub on trial158 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.418 DEBUG:teuthology.orchestra.run.trial158:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:46:30.441 INFO:teuthology.orchestra.run.trial138.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.442 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.442 DEBUG:teuthology.orchestra.run.trial138:> sudo rpm -qi grub2-tools 2026-02-12T22:46:30.484 INFO:teuthology.orchestra.run.trial158.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:46:30.486 DEBUG:teuthology.orchestra.run.trial158:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:46:30.514 INFO:teuthology.orchestra.run.trial138.stdout:Name : grub2-tools 2026-02-12T22:46:30.514 INFO:teuthology.orchestra.run.trial138.stdout:Epoch : 1 2026-02-12T22:46:30.514 INFO:teuthology.orchestra.run.trial138.stdout:Version : 2.12 2026-02-12T22:46:30.514 INFO:teuthology.orchestra.run.trial138.stdout:Release : 29.el10_1 2026-02-12T22:46:30.515 INFO:teuthology.orchestra.run.trial138.stdout:Architecture: x86_64 2026-02-12T22:46:30.515 INFO:teuthology.orchestra.run.trial138.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:46:30.515 INFO:teuthology.orchestra.run.trial138.stdout:Group : Unspecified 2026-02-12T22:46:30.515 INFO:teuthology.orchestra.run.trial138.stdout:Size : 7963769 2026-02-12T22:46:30.515 INFO:teuthology.orchestra.run.trial138.stdout:License : GPL-3.0-or-later 2026-02-12T22:46:30.515 INFO:teuthology.orchestra.run.trial138.stdout:Signature : 2026-02-12T22:46:30.515 INFO:teuthology.orchestra.run.trial138.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:46:30.515 INFO:teuthology.orchestra.run.trial138.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:46:30.515 INFO:teuthology.orchestra.run.trial138.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:46:30.515 INFO:teuthology.orchestra.run.trial138.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:46:30.515 INFO:teuthology.orchestra.run.trial138.stdout:Packager : Release Engineering 2026-02-12T22:46:30.515 INFO:teuthology.orchestra.run.trial138.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:46:30.516 INFO:teuthology.orchestra.run.trial138.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:46:30.516 INFO:teuthology.orchestra.run.trial138.stdout:Summary : Support tools for GRUB. 2026-02-12T22:46:30.516 INFO:teuthology.orchestra.run.trial138.stdout:Description : 2026-02-12T22:46:30.516 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-12T22:46:30.516 INFO:teuthology.orchestra.run.trial138.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:46:30.516 INFO:teuthology.orchestra.run.trial138.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:46:30.516 INFO:teuthology.orchestra.run.trial138.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:46:30.516 INFO:teuthology.orchestra.run.trial138.stdout:hardware devices. 2026-02-12T22:46:30.516 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-12T22:46:30.516 INFO:teuthology.orchestra.run.trial138.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:46:30.517 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:46:30.517 INFO:teuthology.task.kernel:Updating grub on trial138 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.518 DEBUG:teuthology.orchestra.run.trial138:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:46:30.552 INFO:teuthology.orchestra.run.trial158.stdout:/sbin/grubby 2026-02-12T22:46:30.554 INFO:teuthology.orchestra.run.trial158.stdout:yes 2026-02-12T22:46:30.554 DEBUG:teuthology.orchestra.run.trial158:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:46:30.583 INFO:teuthology.orchestra.run.trial138.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:46:30.584 DEBUG:teuthology.orchestra.run.trial138:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:46:30.621 INFO:teuthology.orchestra.run.trial158.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:46:30.622 DEBUG:teuthology.orchestra.run.trial158:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.650 INFO:teuthology.orchestra.run.trial138.stdout:/sbin/grubby 2026-02-12T22:46:30.651 INFO:teuthology.orchestra.run.trial138.stdout:yes 2026-02-12T22:46:30.652 DEBUG:teuthology.orchestra.run.trial138:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:46:30.698 DEBUG:teuthology.orchestra.run.trial158:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:46:30.719 INFO:teuthology.orchestra.run.trial138.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:46:30.720 DEBUG:teuthology.orchestra.run.trial138:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:30.795 DEBUG:teuthology.orchestra.run.trial138:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:46:30.810 INFO:teuthology.orchestra.run.trial158.stderr:Generating grub configuration file ... 2026-02-12T22:46:30.907 INFO:teuthology.orchestra.run.trial138.stderr:Generating grub configuration file ... 2026-02-12T22:46:30.987 INFO:teuthology.orchestra.run.trial158.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:46:30.996 INFO:teuthology.orchestra.run.trial158.stderr:done 2026-02-12T22:46:30.998 DEBUG:teuthology.orchestra.run.trial158:> test -d /sys/firmware/efi 2026-02-12T22:46:31.015 DEBUG:teuthology.orchestra.run.trial158:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:46:31.083 INFO:teuthology.orchestra.run.trial138.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:46:31.086 INFO:teuthology.orchestra.run.trial158.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:46:31.086 INFO:teuthology.orchestra.run.trial158.stdout:/boot/efi/EFI/rocky 2026-02-12T22:46:31.088 DEBUG:teuthology.orchestra.run.trial158:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:46:31.092 INFO:teuthology.orchestra.run.trial138.stderr:done 2026-02-12T22:46:31.094 DEBUG:teuthology.orchestra.run.trial138:> test -d /sys/firmware/efi 2026-02-12T22:46:31.112 DEBUG:teuthology.orchestra.run.trial138:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:46:31.155 INFO:teuthology.orchestra.run.trial158.stdout:no 2026-02-12T22:46:31.155 DEBUG:teuthology.orchestra.run.trial158:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:46:31.183 INFO:teuthology.orchestra.run.trial138.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:46:31.183 INFO:teuthology.orchestra.run.trial138.stdout:/boot/efi/EFI/rocky 2026-02-12T22:46:31.185 DEBUG:teuthology.orchestra.run.trial138:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:46:31.221 INFO:teuthology.orchestra.run.trial158.stdout:yes 2026-02-12T22:46:31.222 DEBUG:teuthology.orchestra.run.trial158:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:46:31.252 INFO:teuthology.orchestra.run.trial138.stdout:no 2026-02-12T22:46:31.253 DEBUG:teuthology.orchestra.run.trial138:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:46:31.288 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial158 2026-02-12T22:46:31.288 DEBUG:teuthology.orchestra.run.trial158:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:46:31.319 INFO:teuthology.orchestra.run.trial138.stdout:yes 2026-02-12T22:46:31.320 DEBUG:teuthology.orchestra.run.trial138:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:46:31.353 INFO:teuthology.orchestra.run.trial158.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:46:31.386 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial138 2026-02-12T22:46:31.386 DEBUG:teuthology.orchestra.run.trial138:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:46:31.452 INFO:teuthology.orchestra.run.trial138.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:47:01.331 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:01.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:01.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:01.431 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:01.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:01.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:01.485 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:01.495 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:01.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:01.503 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:01.503 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:01.559 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:01.559 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:01.559 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:01.559 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:01.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:01.575 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:01.575 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:01.631 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:01.631 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:01.631 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:01.631 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:02.560 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:02.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:02.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:02.659 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:02.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:02.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:02.710 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:02.721 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:02.728 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:02.728 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:02.729 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:02.785 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:02.785 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:02.786 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:02.786 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:02.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:02.794 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:02.794 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:02.852 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:02.853 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:02.853 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:02.853 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:03.787 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:03.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:03.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:03.885 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:03.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:03.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:03.939 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:03.949 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:03.956 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:03.956 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:03.956 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:04.013 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:04.013 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:04.013 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:04.013 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:04.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:04.029 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:04.030 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:04.086 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:04.086 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:04.086 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:04.087 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:05.014 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:05.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:05.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:05.113 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:05.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:05.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:05.166 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:05.176 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:05.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:05.225 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:05.225 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:05.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:05.258 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:05.258 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:05.283 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:05.283 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:05.283 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:05.283 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:05.317 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:05.318 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:05.318 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:05.318 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:06.284 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:06.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:06.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:06.382 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:06.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:06.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:06.435 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:06.444 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:06.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:06.494 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:06.494 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:06.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:06.523 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:06.523 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:06.551 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:06.551 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:06.551 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:06.551 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:06.581 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:06.581 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:06.581 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:06.581 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:07.553 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:07.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:07.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:07.651 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:07.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:07.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:07.704 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:07.714 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:07.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:07.722 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:07.722 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:07.779 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:07.779 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:07.779 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:07.780 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:07.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:07.789 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:07.789 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:07.846 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:07.847 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:07.847 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:07.847 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:08.780 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:08.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:08.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:08.879 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:08.879 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:08.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:08.931 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:08.941 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:08.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:08.949 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:08.949 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:09.007 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:09.007 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:09.007 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:09.007 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:09.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:09.015 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:09.015 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:09.073 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:09.073 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:09.073 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:09.073 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:10.009 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:10.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:10.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:10.109 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:10.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:10.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:10.161 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:10.170 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:10.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:10.219 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:10.219 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:10.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:10.255 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:10.255 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:10.276 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:10.276 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:10.277 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:10.277 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:10.312 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:10.312 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:10.312 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:10.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:11.278 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:11.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:11.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:11.374 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:11.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:11.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:11.425 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:11.435 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:11.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:11.485 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:11.485 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:11.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:11.508 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:11.508 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:11.541 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:11.542 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:11.542 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:11.542 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:11.564 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:11.564 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:11.565 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:11.565 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:12.543 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:12.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:12.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:12.643 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:12.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:12.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:12.695 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:12.705 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:12.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:12.754 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:12.754 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:12.786 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:12.786 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:12.786 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:12.811 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:12.811 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:12.811 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:12.811 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:12.843 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:12.843 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:12.843 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:12.843 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:13.813 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:13.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:13.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:13.911 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:13.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:13.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:13.963 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:13.973 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:13.981 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:13.981 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:13.981 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:14.037 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:14.038 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:14.038 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:14.038 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:14.055 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:14.056 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:14.056 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:14.114 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:14.114 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:14.114 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:14.115 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:15.039 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:15.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:15.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:15.138 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:15.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:15.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:15.190 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:15.200 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:15.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:15.247 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:15.247 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:15.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:15.285 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:15.285 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:15.304 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:15.304 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:15.304 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:15.304 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:15.343 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:15.343 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:15.343 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:15.343 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:16.305 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:16.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:16.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:16.405 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:16.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:16.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:16.457 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:16.467 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:16.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:16.475 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:16.475 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:16.531 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:16.531 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:16.531 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:16.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:16.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:16.544 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:16.544 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:16.602 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:16.602 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:16.602 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:16.602 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:17.532 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:17.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:17.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:17.631 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:17.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:17.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:17.683 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:17.693 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:17.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:17.741 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:17.741 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:17.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:17.767 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:17.767 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:17.798 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:17.798 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:17.798 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:17.798 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:17.824 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:17.825 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:17.825 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:17.825 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:18.799 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:18.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:18.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:18.866 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:18.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:18.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:18.917 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:18.927 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:18.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:18.975 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:18.976 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:19.011 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:19.011 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:19.011 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:19.033 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:19.033 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:19.034 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:19.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:19.069 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:19.069 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:19.069 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:19.069 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:20.034 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:20.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:20.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:20.115 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:20.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:20.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:20.167 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:20.177 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:20.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:20.225 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:20.225 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:20.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:20.255 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:20.255 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:20.281 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:20.281 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:20.282 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:20.282 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:20.312 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:20.312 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:20.312 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:20.312 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:21.282 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:21.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:21.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:21.370 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:21.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:21.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:21.422 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:21.431 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:21.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:21.480 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:21.481 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:21.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:21.505 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:21.505 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:21.537 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:21.537 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:21.537 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:21.537 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:21.562 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:21.562 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:21.562 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:21.563 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:22.538 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:22.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:22.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:22.640 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:22.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:22.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:22.693 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:22.703 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:22.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:22.751 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:22.751 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:22.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:22.776 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:22.776 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:22.809 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:22.809 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:22.809 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:22.809 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:22.834 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:22.834 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:22.834 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:22.834 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:23.810 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:23.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:23.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:23.867 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:23.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:23.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:23.919 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:23.929 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:23.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:23.977 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:23.977 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:24.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:24.017 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:24.017 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:24.034 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:24.034 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:24.034 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:24.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:24.074 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:24.075 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:24.075 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:24.075 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:25.035 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:25.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:25.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:25.081 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:25.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:25.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:25.238 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:25.240 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:25.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:25.314 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:25.314 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:25.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:25.327 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:25.327 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:25.372 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:25.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:25.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:25.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:25.384 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:25.385 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:25.385 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:25.385 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:26.373 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:26.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:26.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:26.473 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:26.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:26.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:26.526 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:26.537 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:26.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:26.544 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:26.544 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:26.601 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:26.601 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:26.601 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:26.601 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:26.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:26.630 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:26.630 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:26.681 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:26.681 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:26.681 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:26.682 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:27.602 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:27.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:27.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:27.701 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:27.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:27.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:27.753 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:27.764 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:27.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:27.770 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:27.771 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:27.826 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:27.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:27.826 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:27.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:27.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:27.846 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:27.846 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:27.903 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:27.903 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:27.903 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:27.903 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:28.827 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:28.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:28.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:28.925 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:28.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:28.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:28.978 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:28.989 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:28.996 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:28.996 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:28.996 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:29.053 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:29.053 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:29.053 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:29.053 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:29.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:29.076 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:29.077 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:29.133 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:29.133 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:29.133 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:29.133 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:30.054 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:30.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:30.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:30.152 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:30.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:30.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:30.204 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:30.214 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:30.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:30.263 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:30.263 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:30.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:30.294 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:30.294 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:30.319 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:30.320 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:30.320 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:30.320 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:30.350 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:30.351 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:30.351 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:30.351 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:31.321 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:31.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:31.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:31.382 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:31.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:31.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:31.433 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:31.444 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:31.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:31.451 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:31.451 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:31.507 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:31.507 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:31.507 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:31.507 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:31.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:31.513 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:31.514 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:31.571 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:31.571 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:31.571 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:31.571 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:32.508 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:32.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:32.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:32.600 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:32.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:32.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:32.651 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:32.661 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:32.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:32.709 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:32.709 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:32.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:32.730 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:32.730 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:32.765 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:32.766 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:32.766 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:32.766 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:32.787 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:32.787 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:32.788 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:32.788 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:33.767 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:33.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:33.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:33.859 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:33.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:33.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:33.910 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:33.921 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:33.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:33.968 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:33.968 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:34.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:34.004 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:34.004 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:34.025 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:34.025 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:34.025 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:34.025 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:34.061 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:34.061 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:34.061 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:34.061 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:35.026 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:35.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:35.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:35.099 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:35.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:35.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:35.149 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:35.160 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:35.207 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:35.207 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:35.207 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:35.237 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:35.237 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:35.237 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:35.264 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:35.264 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:35.264 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:35.264 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:35.294 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:35.294 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:35.295 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:35.295 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:36.264 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:36.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:36.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:36.357 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:36.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:36.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:36.408 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:36.419 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:36.467 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:36.467 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:36.467 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:36.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:36.496 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:36.496 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:36.525 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:36.525 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:36.525 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:36.525 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:36.553 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:36.554 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:36.554 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:36.554 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:37.526 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:37.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:37.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:37.619 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:37.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:37.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:37.671 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:37.682 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:37.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:37.729 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:37.729 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:37.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:37.753 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:37.753 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:37.785 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:37.786 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:37.786 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:37.786 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:37.810 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:37.810 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:37.810 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:37.810 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:38.787 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:38.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:38.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:38.852 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:38.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:38.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:38.904 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:38.915 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:38.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:38.921 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:38.921 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:38.979 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:38.979 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:38.979 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:38.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:38.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:38.993 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:38.993 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:39.050 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:39.050 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:39.050 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:39.050 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:39.981 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:39.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:39.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:40.043 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:40.052 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:40.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:40.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:40.116 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:40.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:40.123 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:40.123 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:40.180 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:40.181 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:40.181 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:40.181 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:40.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:40.199 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:40.199 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:40.256 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:40.257 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:40.257 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:40.257 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:41.181 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:41.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:41.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:41.263 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:41.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:41.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:41.314 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:41.325 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:41.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:41.331 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:41.331 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:41.388 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:41.388 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:41.388 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:41.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:41.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:41.409 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:41.409 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:41.466 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:41.466 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:41.466 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:41.466 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:42.389 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:42.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:42.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:42.491 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:42.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:42.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:42.542 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:42.553 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:42.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:42.601 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:42.601 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:42.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:42.625 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:42.625 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:42.657 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:42.657 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:42.657 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:42.657 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:42.681 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:42.681 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:42.682 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:42.682 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:43.658 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:43.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:43.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:43.757 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:43.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:43.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:43.808 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:43.820 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:43.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:43.826 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:43.826 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:43.883 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:43.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:43.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:43.884 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:43.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:43.897 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:43.897 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:43.954 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:43.954 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:43.954 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:43.954 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:44.885 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:44.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:44.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:44.983 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:44.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:44.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:44.994 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:45.059 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:45.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:45.072 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:45.072 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:45.129 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:45.129 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:45.129 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:45.129 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:45.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:45.139 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:45.139 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:45.196 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:45.197 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:45.197 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:45.197 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:46.129 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:46.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:46.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:46.228 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:46.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:46.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:46.280 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:46.291 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:46.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:46.298 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:46.298 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:46.355 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:46.355 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:46.355 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:46.355 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:46.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:46.374 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:46.375 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:46.431 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:46.432 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:46.432 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:46.432 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:47.355 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:47.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:47.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:47.460 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:47.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:47.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:47.512 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:47.522 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:47.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:47.571 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:47.571 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:47.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:47.605 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:47.605 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:47.628 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:47.628 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:47.628 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:47.628 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:47.663 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:47.663 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:47.664 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:47.664 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:48.630 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:48.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:48.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:48.728 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:48.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:48.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:48.780 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:48.791 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:48.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:48.797 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:48.797 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:48.855 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:48.855 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:48.855 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:48.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:48.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:48.878 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:48.879 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:48.936 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:48.936 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:48.936 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:48.936 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:49.856 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:49.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:49.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:49.952 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:49.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:49.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:50.004 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:50.014 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:50.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:50.062 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:50.062 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:50.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:50.104 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:50.104 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:50.119 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:50.119 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:50.119 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:50.119 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:50.161 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:50.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:50.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:50.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:51.120 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:51.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:51.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:51.219 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:51.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:51.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:51.271 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:51.282 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:51.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:51.288 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:51.288 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:51.345 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:51.345 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:51.345 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:51.345 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:51.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:51.356 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:51.356 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:51.412 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:51.412 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:51.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:51.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:52.345 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:52.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:52.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:52.445 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:52.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:52.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:52.497 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:52.508 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:52.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:52.556 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:52.556 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:52.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:52.585 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:52.585 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:52.613 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:52.613 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:52.614 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:52.614 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:52.641 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:52.642 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:52.642 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:52.642 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:53.615 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:53.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:53.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:53.715 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:53.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:53.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:53.767 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:53.778 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:53.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:53.784 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:53.784 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:53.840 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:53.840 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:53.840 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:53.840 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:53.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:53.864 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:53.864 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:53.922 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:53.922 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:53.922 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:53.922 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:54.841 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:54.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:54.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:54.939 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:54.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:54.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:54.990 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:55.000 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:55.048 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:55.048 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:55.048 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:55.075 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:55.075 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:55.075 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:55.104 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:55.104 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:55.104 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:55.104 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:55.132 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:55.132 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:55.132 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:55.132 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:56.106 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:56.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:56.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:56.196 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:56.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:56.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:56.247 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:56.258 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:56.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:56.305 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:56.305 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:56.335 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:56.335 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:56.335 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:56.362 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:56.363 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:56.363 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:56.363 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:56.392 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:56.392 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:56.392 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:56.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:57.363 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:57.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:57.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:57.460 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:57.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:57.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:57.511 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:57.522 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:57.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:57.570 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:57.571 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:57.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:57.613 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:57.613 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:57.627 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:57.627 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:57.627 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:57.627 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:57.670 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:57.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:57.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:57.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:58.628 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:58.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:58.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:58.728 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:58.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:58.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:58.780 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:47:58.791 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:47:58.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:58.797 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:58.797 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:47:58.854 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:58.855 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:58.855 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:58.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:58.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:58.880 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:47:58.880 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:47:58.939 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:58.939 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:47:58.939 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:47:58.939 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:47:59.856 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:47:59.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:47:59.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:59.954 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:47:59.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:47:59.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:00.005 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:00.016 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:00.023 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:00.023 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:00.023 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:00.080 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:00.080 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.080 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:00.080 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:00.095 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:00.095 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:00.096 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:00.152 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:00.153 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.153 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:00.153 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:01.081 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:01.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:01.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:01.180 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:01.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:01.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:01.232 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:01.242 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:01.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:01.249 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:01.249 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:01.306 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:01.306 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:01.306 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:01.306 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:01.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:01.324 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:01.324 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:01.382 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:01.382 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:01.382 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:01.382 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:02.307 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:02.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:02.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:02.406 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:02.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:02.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:02.458 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:02.469 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:02.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:02.516 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:02.516 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:02.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:02.544 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:02.544 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:02.573 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:02.573 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:02.573 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:02.573 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:02.600 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:02.600 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:02.600 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:02.600 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:03.573 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:03.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:03.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:03.672 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:03.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:03.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:03.725 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:03.736 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:03.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:03.742 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:03.743 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:03.800 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:03.801 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:03.801 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:03.801 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:03.819 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:03.819 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:03.819 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:03.877 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:03.878 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:03.878 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:03.878 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:04.801 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:04.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:04.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:04.900 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:04.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:04.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:04.953 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:04.963 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:04.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:04.970 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:04.970 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:05.028 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:05.028 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:05.028 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:05.028 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:05.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:05.037 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:05.037 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:05.094 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:05.095 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:05.095 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:05.095 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:06.029 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:06.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:06.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:06.127 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:06.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:06.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:06.178 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:06.189 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:06.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:06.236 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:06.236 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:06.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:06.266 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:06.266 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:06.292 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:06.293 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:06.293 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:06.293 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:06.322 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:06.322 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:06.323 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:06.323 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:07.294 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:07.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:07.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:07.393 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:07.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:07.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:07.446 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:07.456 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:07.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:07.463 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:07.463 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:07.520 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:07.520 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:07.520 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:07.520 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:07.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:07.540 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:07.540 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:07.597 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:07.598 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:07.598 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:07.598 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:08.520 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:08.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:08.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:08.618 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:08.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:08.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:08.671 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:08.682 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:08.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:08.690 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:08.690 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:08.746 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:08.747 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:08.747 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:08.747 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:08.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:08.773 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:08.773 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:08.830 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:08.830 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:08.831 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:08.831 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:09.748 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:09.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:09.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:09.846 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:09.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:09.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:09.898 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:09.909 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:09.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:09.916 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:09.916 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:09.973 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:09.973 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:09.973 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:09.973 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:09.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:09.990 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:09.990 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:10.046 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:10.047 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:10.047 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:10.047 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:10.974 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:10.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:10.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:11.073 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:11.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:11.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:11.126 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:11.136 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:11.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:11.143 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:11.143 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:11.200 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:11.200 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:11.200 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:11.200 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:11.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:11.219 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:11.219 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:11.277 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:11.278 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:11.278 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:11.278 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:12.202 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:12.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:12.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:12.279 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:12.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:12.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:12.287 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:12.342 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:12.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:12.366 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:12.366 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:12.423 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:12.423 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:12.423 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:12.423 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:12.424 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:12.424 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:12.424 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:12.481 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:12.481 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:12.481 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:12.482 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:13.424 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:13.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:13.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:13.483 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:13.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:13.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:13.535 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:13.546 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:13.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:13.552 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:13.553 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:13.610 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:13.610 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:13.610 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:13.610 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:13.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:13.633 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:13.633 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:13.691 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:13.691 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:13.691 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:13.691 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:14.611 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:14.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:14.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:14.711 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:14.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:14.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:14.789 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:14.800 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:14.807 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:14.807 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:14.807 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:14.864 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:14.864 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.864 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:14.864 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:14.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:14.889 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:14.889 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:14.947 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:14.947 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.947 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:14.947 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:15.865 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:15.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:15.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:15.965 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:15.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:15.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:16.017 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:16.027 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:16.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:16.073 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:16.073 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:16.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:16.108 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:16.108 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:16.130 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:16.130 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:16.130 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:16.131 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:16.166 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:16.166 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:16.166 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:16.166 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:17.131 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:17.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:17.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:17.230 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:17.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:17.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:17.286 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:17.297 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:17.345 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:17.345 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:17.345 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:17.371 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:17.371 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:17.371 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:17.402 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:17.402 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:17.402 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:17.402 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:17.429 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:17.429 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:17.429 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:17.429 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:18.403 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:18.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:18.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:18.503 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:18.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:18.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:18.556 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:18.567 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:18.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:18.574 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:18.574 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:18.630 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:18.630 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:18.630 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:18.630 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:18.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:18.658 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:18.658 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:18.715 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:18.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:18.715 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:18.715 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:19.631 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:19.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:19.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:19.731 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:19.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:19.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:19.811 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:19.823 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:19.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:19.831 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:19.831 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:19.887 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:19.887 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:19.887 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:19.887 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:19.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:19.895 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:19.895 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:19.952 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:19.953 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:19.953 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:19.953 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:20.889 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:20.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:20.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:20.971 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:20.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:20.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:21.049 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:21.059 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:21.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:21.067 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:21.068 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:21.124 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:21.124 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:21.124 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:21.124 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:21.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:21.144 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:21.144 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:21.202 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:21.202 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:21.202 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:21.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:22.125 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:22.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:22.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:22.239 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:22.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:22.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:22.249 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:22.302 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:22.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:22.336 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:22.336 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:22.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:22.384 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:22.385 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:22.392 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:22.392 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:22.392 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:22.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:22.441 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:22.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:22.441 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:22.441 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:23.393 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:23.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:23.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:23.452 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:23.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:23.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:23.504 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:23.515 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:23.562 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:23.562 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:23.562 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:23.593 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:23.593 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:23.593 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:23.618 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:23.619 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:23.619 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:23.619 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:23.650 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:23.650 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:23.650 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:23.650 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:24.619 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:24.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:24.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:24.715 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:24.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:24.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:24.766 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:24.777 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:24.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:24.824 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:24.824 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:24.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:24.851 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:24.851 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:24.881 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:24.881 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:24.881 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:24.881 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:24.908 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:24.908 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:24.908 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:24.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:25.882 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:25.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:25.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:25.981 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:25.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:25.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:26.034 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:26.044 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:26.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:26.051 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:26.051 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:26.108 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:26.108 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:26.108 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:26.108 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:26.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:26.126 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:26.126 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:26.183 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:26.184 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:26.184 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:26.184 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:27.109 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:27.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:27.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:27.208 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:27.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:27.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:27.260 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:27.271 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:27.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:27.318 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:27.318 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:27.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:27.353 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:27.353 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:27.374 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:27.374 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:27.374 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:27.375 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:27.410 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:27.410 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:27.410 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:27.410 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:28.376 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:28.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:28.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:28.475 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:28.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:28.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:28.526 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:28.536 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:28.584 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:28.585 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:28.585 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:28.609 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:28.610 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:28.610 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:28.642 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:28.642 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:28.642 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:28.642 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:28.665 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:28.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:28.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:28.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:29.643 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:29.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:29.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:29.742 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:29.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:29.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:29.794 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:29.806 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:29.812 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:29.812 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:29.812 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:29.870 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:29.870 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:29.870 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:29.870 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:29.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:29.883 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:29.883 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:29.940 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:29.941 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:29.941 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:29.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:30.871 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:30.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:30.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:30.970 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:30.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:30.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:31.022 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:31.033 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:31.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:31.078 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:31.079 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:31.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:31.107 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:31.107 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:31.135 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:31.135 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:31.135 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:31.135 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:31.165 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:31.165 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:31.165 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:31.166 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:32.136 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:32.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:32.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:32.238 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:32.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:32.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:32.289 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:32.300 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:32.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:32.307 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:32.307 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:32.365 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:32.365 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:32.365 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:32.365 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:32.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:32.383 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:32.383 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:32.441 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:32.442 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:32.442 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:32.442 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:33.366 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:33.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:33.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:33.465 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:33.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:33.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:33.518 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:33.528 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:33.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:33.535 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:33.535 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:33.592 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:33.592 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:33.592 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:33.592 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:33.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:33.600 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:33.600 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:33.655 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:33.656 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:33.656 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:33.656 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:34.593 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:34.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:34.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:34.692 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:34.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:34.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:34.745 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:34.755 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:34.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:34.762 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:34.762 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:34.819 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:34.819 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:34.819 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:34.819 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:34.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:34.841 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:34.841 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:34.898 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:34.898 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:34.898 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:34.898 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:35.820 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:35.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:35.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:35.919 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:35.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:35.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:35.971 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:35.982 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:36.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:36.030 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:36.030 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:36.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:36.072 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:36.072 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:36.086 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:36.086 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:36.086 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:36.087 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:36.128 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:36.128 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:36.128 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:36.128 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:37.087 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:37.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:37.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:37.153 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:37.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:37.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:37.204 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:37.215 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:37.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:37.262 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:37.262 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:37.292 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:37.292 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:37.292 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:37.319 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:37.319 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:37.320 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:37.320 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:37.349 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:37.349 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:37.349 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:37.349 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:38.321 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:38.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:38.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:38.403 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:38.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:38.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:38.454 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:38.465 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:38.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:38.473 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:38.473 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:38.530 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:38.531 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:38.531 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:38.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:38.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:38.549 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:38.549 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:38.606 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:38.606 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:38.606 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:38.606 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:39.532 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:39.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:39.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:39.630 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:39.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:39.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:39.683 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:39.693 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:39.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:39.700 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:39.700 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:39.756 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:39.756 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:39.757 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:39.757 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:39.768 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:39.768 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:39.768 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:39.826 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:39.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:39.826 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:39.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:40.758 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:40.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:40.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:40.858 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:40.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:40.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:40.911 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:40.922 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:40.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:40.929 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:40.929 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:40.985 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:40.985 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:40.985 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:40.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:41.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:41.003 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:41.003 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:41.059 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:41.060 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:41.060 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:41.060 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:41.986 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:41.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:41.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:42.085 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:42.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:42.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:42.138 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:42.149 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:42.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:42.156 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:42.156 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:42.212 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:42.212 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:42.212 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:42.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:42.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:42.231 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:42.231 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:42.290 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:42.290 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:42.291 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:42.291 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:43.214 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:43.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:43.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:43.313 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:43.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:43.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:43.365 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:43.376 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:43.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:43.382 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:43.382 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:43.439 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:43.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:43.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:43.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:43.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:43.454 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:43.454 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:43.512 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:43.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:43.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:43.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:44.440 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:44.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:44.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:44.538 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:44.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:44.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:44.590 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:44.601 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:44.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:44.608 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:44.608 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:44.664 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:44.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:44.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:44.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:44.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:44.688 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:44.688 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:44.745 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:44.745 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:44.746 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:44.746 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:45.666 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:45.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:45.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:45.764 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:45.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:45.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:45.816 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:45.827 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:45.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:45.833 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:45.833 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:45.891 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:45.891 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:45.891 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:45.891 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:45.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:45.907 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:45.907 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:45.965 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:45.965 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:45.965 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:45.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:46.892 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:46.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:46.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:46.990 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:46.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:46.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:47.042 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:47.053 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:47.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:47.060 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:47.060 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:47.117 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:47.117 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:47.118 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:47.118 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:47.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:47.138 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:47.138 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:47.196 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:47.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:47.196 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:47.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:48.118 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:48.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:48.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:48.203 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:48.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:48.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:48.255 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:48.265 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:48.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:48.313 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:48.313 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:48.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:48.343 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:48.343 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:48.369 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:48.369 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:48.370 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:48.370 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:48.401 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:48.401 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:48.401 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:48.402 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:49.371 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:49.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:49.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:49.456 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:49.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:49.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:49.508 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:49.518 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:49.526 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:49.526 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:49.526 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:49.582 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:49.582 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:49.582 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:49.582 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:49.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:49.602 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:49.602 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:49.659 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:49.659 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:49.659 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:49.659 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:50.583 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:50.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:50.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:50.683 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:50.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:50.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:50.734 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:50.745 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:50.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:50.752 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:50.752 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:50.809 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:50.809 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:50.809 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:50.809 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:50.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:50.826 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:50.826 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:50.882 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:50.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:50.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:50.883 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:51.810 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:51.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:51.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:51.893 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:51.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:51.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:51.945 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:51.956 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:51.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:51.962 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:51.963 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:52.019 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:52.019 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:52.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:52.019 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:52.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:52.032 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:52.032 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:52.089 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:52.089 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:52.090 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:52.090 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:53.020 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:53.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:53.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:53.118 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:53.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:53.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:53.170 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:53.180 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:53.187 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:53.187 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:53.187 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:53.243 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:53.243 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:53.243 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:53.243 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:53.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:53.254 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:53.255 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:53.312 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:53.312 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:53.312 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:53.312 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:54.245 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:54.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:54.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:54.342 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:54.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:54.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:54.395 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:54.405 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:54.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:54.412 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:54.412 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:54.470 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:54.471 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:54.471 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:54.471 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:54.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:54.480 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:54.480 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:54.537 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:54.537 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:54.537 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:54.537 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:55.472 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:55.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:55.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:55.572 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:55.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:55.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:55.623 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:55.634 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:55.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:55.682 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:55.682 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:55.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:55.712 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:55.712 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:55.739 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:55.739 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:55.739 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:55.739 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:55.769 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:55.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:55.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:55.770 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:56.741 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:56.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:56.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:56.839 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:56.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:56.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:56.890 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:56.901 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:56.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:56.948 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:56.949 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:56.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:56.979 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:56.979 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:57.005 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:57.005 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:57.005 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:57.005 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:57.035 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:57.035 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:57.035 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:57.035 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:58.006 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:58.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:58.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:58.105 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:58.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:58.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:58.155 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:58.166 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:58.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:58.214 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:58.214 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:58.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:58.237 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:58.237 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:58.271 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:58.271 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:58.271 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:58.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:58.293 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:58.294 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:58.294 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:58.294 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:59.272 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:48:59.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:59.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:59.370 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:48:59.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:59.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:59.423 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:48:59.434 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:48:59.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:48:59.481 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:59.481 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:48:59.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:48:59.514 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:59.514 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:48:59.538 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:59.539 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:59.539 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:59.539 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:59.572 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:59.572 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:59.572 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:59.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:00.539 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:00.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:00.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:00.641 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:00.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:00.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:00.692 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:00.703 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:00.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:00.710 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:00.710 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:00.768 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:00.768 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:00.768 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:00.768 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:00.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:00.779 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:00.779 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:00.835 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:00.836 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:00.836 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:00.836 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:01.769 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:01.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:01.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:01.868 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:01.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:01.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:01.920 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:01.931 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:01.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:01.978 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:01.978 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:02.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:02.018 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:02.018 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:02.036 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:02.036 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:02.036 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:02.036 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:02.075 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:02.076 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:02.076 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:02.076 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:03.037 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:03.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:03.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:03.100 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:03.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:03.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:03.152 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:03.163 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:03.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:03.170 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:03.170 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:03.226 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:03.226 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:03.226 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:03.226 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:03.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:03.247 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:03.247 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:03.305 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:03.305 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:03.305 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:03.306 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:04.227 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:04.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:04.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:04.328 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:04.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:04.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:04.380 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:04.391 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:04.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:04.398 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:04.398 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:04.455 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:04.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:04.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:04.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:04.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:04.463 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:04.463 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:04.521 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:04.522 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:04.522 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:04.522 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:05.455 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:05.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:05.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:05.554 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:05.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:05.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:05.607 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:05.617 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:05.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:05.624 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:05.625 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:05.683 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:05.683 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:05.683 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:05.683 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:05.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:05.694 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:05.694 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:05.752 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:05.752 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:05.752 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:05.752 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:06.684 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:06.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:06.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:06.783 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:06.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:06.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:06.836 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:06.847 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:06.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:06.853 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:06.853 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:06.909 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:06.909 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:06.909 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:06.909 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:06.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:06.929 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:06.929 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:06.985 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:06.986 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:06.986 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:06.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:07.910 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:07.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:07.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:08.008 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:08.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:08.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:08.069 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:08.081 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:08.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:08.088 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:08.088 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:08.145 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:08.145 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.145 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:08.145 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:08.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:08.155 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:08.155 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:08.212 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:08.212 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.212 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:08.212 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:09.146 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:09.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:09.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:09.225 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:09.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:09.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:09.235 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:09.289 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:09.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:09.317 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:09.317 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:09.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:09.365 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:09.365 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:09.373 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:09.373 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:09.373 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:09.373 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:09.423 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:09.423 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:09.423 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:09.423 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:10.375 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:10.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:10.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:10.473 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:10.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:10.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:10.526 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:10.537 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:10.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:10.543 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:10.543 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:10.600 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:10.601 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:10.601 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:10.601 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:10.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:10.619 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:10.619 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:10.676 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:10.677 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:10.677 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:10.677 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:11.601 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:11.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:11.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:11.665 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:11.678 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:11.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:11.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:11.746 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:11.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:11.752 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:11.753 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:11.810 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:11.810 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:11.810 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:11.810 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:11.819 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:11.819 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:11.820 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:11.877 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:11.877 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:11.878 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:11.878 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:12.811 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:12.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:12.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:12.884 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:12.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:12.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:12.935 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:12.945 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:12.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:12.994 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:12.994 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:13.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:13.018 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:13.018 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:13.050 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:13.050 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:13.050 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:13.050 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:13.075 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:13.076 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:13.076 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:13.076 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:14.051 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:14.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:14.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:14.149 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:14.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:14.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:14.202 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:14.213 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:14.260 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:14.260 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:14.260 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:14.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:14.290 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:14.290 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:14.316 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:14.316 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:14.317 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:14.317 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:14.347 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:14.347 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:14.347 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:14.347 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:15.317 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:15.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:15.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:15.427 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:15.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:15.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:15.501 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:15.512 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:15.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:15.520 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:15.520 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:15.576 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:15.577 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:15.577 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:15.577 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:15.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:15.587 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:15.587 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:15.646 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:15.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:15.646 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:15.646 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:16.577 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:16.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:16.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:16.677 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:16.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:16.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:16.729 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:16.740 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:16.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:16.747 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:16.747 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:16.803 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:16.804 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:16.804 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:16.804 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:16.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:16.825 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:16.825 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:16.882 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:16.882 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:16.882 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:16.883 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:17.804 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:17.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:17.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:17.903 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:17.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:17.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:17.954 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:17.965 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:18.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:18.013 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:18.013 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:18.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:18.043 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:18.043 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:18.070 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:18.070 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:18.070 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:18.070 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:18.098 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:18.098 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:18.098 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:18.099 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:19.072 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:19.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:19.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:19.172 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:19.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:19.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:19.224 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:19.235 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:19.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:19.241 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:19.242 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:19.298 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:19.298 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:19.298 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:19.298 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:19.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:19.324 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:19.325 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:19.382 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:19.382 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:19.382 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:19.383 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:20.299 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:20.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:20.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:20.400 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:20.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:20.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:20.481 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:20.492 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:20.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:20.499 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:20.499 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:20.555 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:20.556 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:20.556 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:20.556 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:20.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:20.568 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:20.568 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:20.624 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:20.624 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:20.624 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:20.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:21.557 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:21.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:21.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:21.657 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:21.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:21.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:21.709 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:21.720 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:21.768 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:21.768 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:21.768 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:21.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:21.806 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:21.806 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:21.825 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:21.825 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:21.826 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:21.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:21.863 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:21.863 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:21.863 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:21.863 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:22.827 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:22.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:22.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:22.928 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:22.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:22.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:22.982 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:22.993 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:22.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:22.999 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:22.999 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:23.057 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:23.058 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:23.058 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:23.058 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:23.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:23.079 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:23.079 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:23.137 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:23.137 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:23.137 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:23.137 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:24.059 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:24.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:24.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:24.158 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:24.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:24.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:24.209 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:24.220 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:24.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:24.270 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:24.270 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:24.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:24.301 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:24.301 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:24.326 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:24.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:24.327 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:24.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:24.358 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:24.358 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:24.358 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:24.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:25.328 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:25.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:25.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:25.426 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:25.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:25.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:25.478 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:25.489 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:25.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:25.496 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:25.496 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:25.552 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:25.552 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:25.552 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:25.552 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:25.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:25.569 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:25.569 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:25.626 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:25.626 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:25.626 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:25.626 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:26.552 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:26.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:26.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:26.622 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:26.627 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:26.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:26.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:26.694 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:26.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:26.701 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:26.701 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:26.757 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:26.757 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:26.757 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:26.758 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:26.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:26.764 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:26.764 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:26.820 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:26.820 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:26.820 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:26.820 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:27.758 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:27.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:27.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:27.863 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:27.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:27.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:27.915 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:27.926 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:27.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:27.932 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:27.932 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:27.989 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:27.989 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:27.989 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:27.989 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:28.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:28.000 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:28.000 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:28.058 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:28.059 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:28.059 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:28.059 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:28.990 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:28.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:28.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:29.060 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:29.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:29.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:29.063 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:29.124 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:29.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:29.137 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:29.137 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:29.193 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:29.193 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:29.193 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:29.193 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:29.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:29.206 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:29.206 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:29.264 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:29.264 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:29.264 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:29.264 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:30.195 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:30.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:30.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:30.270 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:30.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:30.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:30.322 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:30.333 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:30.379 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:30.380 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:30.380 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:30.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:30.417 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:30.417 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:30.436 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:30.436 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:30.436 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:30.436 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:30.474 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:30.474 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:30.474 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:30.475 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:31.438 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:31.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:31.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:31.536 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:31.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:31.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:31.587 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:31.598 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:31.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:31.647 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:31.648 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:31.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:31.683 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:31.683 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:31.704 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:31.705 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:31.705 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:31.705 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:31.740 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:31.740 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:31.740 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:31.740 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:32.706 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:32.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:32.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:32.803 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:32.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:32.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:32.855 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:32.865 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:32.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:32.914 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:32.914 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:32.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:32.941 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:32.941 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:32.972 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:32.972 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:32.972 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:32.972 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:32.998 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:32.998 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:32.998 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:32.999 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:33.973 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:33.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:33.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:34.073 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:34.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:34.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:34.126 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:34.137 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:34.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:34.144 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:34.144 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:34.200 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:34.201 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:34.201 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:34.201 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:34.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:34.212 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:34.212 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:34.270 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:34.270 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:34.270 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:34.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:35.202 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:35.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:35.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:35.301 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:35.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:35.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:35.352 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:35.363 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:35.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:35.369 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:35.370 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:35.427 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:35.427 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:35.428 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:35.428 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:35.436 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:35.436 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:35.436 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:35.494 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:35.494 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:35.494 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:35.495 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:36.429 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:36.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:36.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:36.527 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:36.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:36.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:36.580 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:36.591 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:36.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:36.597 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:36.597 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:36.654 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:36.654 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:36.654 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:36.654 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:36.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:36.670 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:36.670 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:36.727 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:36.727 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:36.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:36.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:37.655 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:37.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:37.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:37.753 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:37.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:37.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:37.806 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:37.817 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:37.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:37.823 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:37.824 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:37.881 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:37.881 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:37.881 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:37.881 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:37.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:37.892 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:37.892 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:37.950 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:37.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:37.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:37.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:38.881 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:38.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:38.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:38.982 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:38.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:38.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:39.034 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:39.045 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:39.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:39.092 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:39.092 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:39.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:39.121 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:39.121 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:39.148 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:39.148 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:39.148 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:39.148 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:39.178 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:39.178 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:39.178 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:39.178 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:40.149 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:40.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:40.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:40.248 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:40.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:40.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:40.301 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:40.311 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:40.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:40.318 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:40.318 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:40.376 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:40.376 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:40.376 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:40.376 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:40.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:40.397 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:40.397 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:40.454 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:40.454 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:40.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:40.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:41.377 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:41.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:41.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:41.475 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:41.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:41.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:41.527 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:41.537 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:41.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:41.544 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:41.544 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:41.602 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:41.602 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:41.602 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:41.602 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:41.621 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:41.621 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:41.621 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:41.678 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:41.678 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:41.679 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:41.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:42.602 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:42.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:42.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:42.702 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:42.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:42.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:42.759 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:42.769 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:42.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:42.775 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:42.776 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:42.833 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:42.833 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:42.833 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:42.833 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:42.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:42.842 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:42.842 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:42.899 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:42.900 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:42.900 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:42.900 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:43.833 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:43.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:43.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:43.932 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:43.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:43.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:43.984 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:43.994 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:44.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:44.042 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:44.042 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:44.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:44.083 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:44.083 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:44.099 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:44.099 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:44.099 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:44.099 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:44.140 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:44.141 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:44.141 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:44.141 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:45.100 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:45.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:45.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:45.163 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:45.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:45.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:45.216 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:45.226 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:45.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:45.274 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:45.274 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:45.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:45.314 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:45.315 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:45.332 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:45.332 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:45.332 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:45.332 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:45.371 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:45.371 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:45.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:45.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:46.333 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:46.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:46.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:46.408 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:46.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:46.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:46.459 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:46.470 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:46.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:46.517 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:46.517 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:46.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:46.549 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:46.549 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:46.574 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:46.574 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:46.575 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:46.575 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:46.606 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:46.606 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:46.606 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:46.606 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:47.575 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:47.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:47.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:47.653 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:47.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:47.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:47.706 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:47.716 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:47.724 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:47.724 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:47.724 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:47.781 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:47.782 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:47.782 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:47.782 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:47.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:47.797 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:47.797 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:47.854 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:47.854 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:47.855 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:47.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:48.783 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:48.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:48.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:48.882 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:48.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:48.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:48.933 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:48.944 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:48.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:48.990 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:48.990 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:49.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:49.029 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:49.029 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:49.046 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:49.046 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:49.046 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:49.046 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:49.085 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:49.085 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:49.085 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:49.085 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:50.048 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:50.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:50.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:50.146 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:50.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:50.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:50.198 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:50.209 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:50.216 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:50.216 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:50.216 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:50.274 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:50.274 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:50.274 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:50.274 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:50.292 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:50.293 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:50.293 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:50.350 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:50.351 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:50.351 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:50.351 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:51.275 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:51.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:51.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:51.374 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:51.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:51.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:51.427 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:51.438 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:51.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:51.444 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:51.445 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:51.501 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:51.501 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:51.501 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:51.501 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:51.515 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:51.515 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:51.515 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:51.572 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:51.572 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:51.572 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:51.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:52.502 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:52.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:52.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:52.601 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:52.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:52.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:52.683 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:52.694 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:52.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:52.702 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:52.702 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:52.758 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:52.758 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:52.758 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:52.758 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:52.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:52.775 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:52.775 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:52.832 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:52.832 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:52.832 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:52.832 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:53.759 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:53.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:53.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:53.857 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:53.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:53.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:53.920 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:53.931 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:53.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:53.937 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:53.937 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:53.994 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:53.994 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:53.994 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:53.995 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:54.008 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:54.008 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:54.008 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:54.066 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:54.066 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:54.066 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:54.066 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:54.996 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:54.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:54.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:55.094 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:55.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:55.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:55.155 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:55.166 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:55.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:55.172 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:55.172 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:55.229 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:55.229 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:55.229 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:55.229 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:55.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:55.247 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:55.247 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:55.305 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:55.305 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:55.305 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:55.305 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:56.230 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:56.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:56.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:56.352 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:56.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:56.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:56.362 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:56.415 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:56.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:56.444 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:56.444 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:56.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:56.496 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:56.496 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:56.500 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:56.501 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:56.501 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:56.501 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:56.554 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:56.554 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:56.554 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:56.554 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:57.502 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:57.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:57.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:57.597 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:57.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:57.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:57.607 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:57.660 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:57.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:57.680 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:57.680 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:57.737 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:57.737 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:57.737 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:57.737 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:57.739 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:57.739 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:57.739 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:57.796 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:57.797 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:57.797 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:57.797 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:58.738 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:58.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:58.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:58.830 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:49:58.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:58.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:58.882 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:49:58.893 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:49:58.942 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:49:58.942 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:58.942 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:49:58.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:49:58.974 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:58.974 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:49:58.998 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:58.998 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:58.998 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:58.998 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:59.030 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:59.031 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:59.031 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:59.031 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:59.999 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:49:59.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:00.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:00.099 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:00.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:00.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:00.151 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:00.162 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:00.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:00.169 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:00.169 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:00.226 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:00.230 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:00.230 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:00.230 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:00.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:00.247 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:00.247 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:00.304 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:00.304 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:00.305 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:00.305 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:01.230 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:01.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:01.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:01.301 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:01.306 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:01.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:01.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:01.370 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:01.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:01.384 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:01.384 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:01.441 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:01.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:01.441 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:01.441 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:01.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:01.453 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:01.453 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:01.510 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:01.510 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:01.510 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:01.511 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:02.442 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:02.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:02.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:02.543 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:02.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:02.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:02.596 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:02.605 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:02.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:02.613 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:02.613 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:02.669 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:02.669 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:02.669 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:02.669 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:02.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:02.684 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:02.684 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:02.742 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:02.742 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:02.743 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:02.743 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:03.670 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:03.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:03.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:03.767 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:03.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:03.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:03.819 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:03.829 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:03.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:03.877 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:03.877 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:03.909 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:03.909 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:03.909 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:03.935 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:03.935 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:03.935 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:03.935 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:03.967 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:03.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:03.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:03.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:04.936 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:04.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:04.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:05.013 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:05.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:05.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:05.066 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:05.077 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:05.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:05.083 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:05.083 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:05.140 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:05.140 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:05.140 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:05.141 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:05.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:05.152 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:05.152 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:05.210 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:05.210 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:05.210 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:05.210 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:06.141 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:06.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:06.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:06.239 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:06.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:06.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:06.292 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:06.303 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:06.310 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:06.310 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:06.310 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:06.366 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:06.366 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:06.366 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:06.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:06.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:06.389 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:06.389 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:06.447 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:06.447 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:06.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:06.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:07.368 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:07.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:07.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:07.466 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:07.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:07.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:07.519 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:07.530 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:07.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:07.536 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:07.536 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:07.592 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:07.592 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:07.593 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:07.593 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:07.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:07.614 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:07.614 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:07.671 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:07.672 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:07.672 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:07.672 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:08.594 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:08.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:08.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:08.685 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:08.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:08.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:08.745 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:08.756 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:08.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:08.763 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:08.763 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:08.821 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:08.821 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:08.822 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:08.822 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:08.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:08.835 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:08.835 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:08.892 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:08.892 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:08.892 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:08.892 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:09.823 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:09.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:09.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:09.889 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:09.893 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:09.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:09.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:09.960 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:09.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:09.969 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:09.969 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:10.025 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:10.025 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:10.025 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:10.025 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:10.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:10.042 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:10.042 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:10.099 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:10.099 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:10.099 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:10.099 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:11.026 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:11.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:11.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:11.125 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:11.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:11.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:11.177 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:11.188 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:11.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:11.194 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:11.195 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:11.252 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:11.252 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:11.252 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:11.252 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:11.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:11.269 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:11.269 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:11.325 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:11.326 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:11.326 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:11.326 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:12.253 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:12.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:12.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:12.351 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:12.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:12.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:12.403 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:12.414 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:12.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:12.421 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:12.421 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:12.477 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:12.477 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:12.477 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:12.477 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:12.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:12.491 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:12.492 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:12.549 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:12.549 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:12.549 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:12.549 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:13.478 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:13.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:13.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:13.577 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:13.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:13.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:13.629 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:13.640 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:13.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:13.647 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:13.647 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:13.704 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:13.704 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:13.704 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:13.704 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:13.725 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:13.725 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:13.726 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:13.784 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:13.784 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:13.784 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:13.785 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:14.705 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:14.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:14.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:14.803 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:14.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:14.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:14.855 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:14.866 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:14.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:14.873 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:14.873 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:14.930 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:14.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:14.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:14.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:14.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:14.954 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:14.954 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:15.011 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:15.012 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:15.012 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:15.012 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:15.931 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:15.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:15.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:16.030 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:16.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:16.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:16.083 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:16.093 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:16.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:16.100 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:16.100 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:16.157 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:16.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:16.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:16.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:16.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:16.174 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:16.174 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:16.231 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:16.231 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:16.231 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:16.231 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:17.159 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:17.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:17.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:17.257 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:17.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:17.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:17.309 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:17.320 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:17.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:17.369 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:17.369 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:17.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:17.400 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:17.400 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:17.426 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:17.426 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:17.426 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:17.426 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:17.456 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:17.457 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:17.457 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:17.457 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:18.427 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:18.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:18.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:18.527 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:18.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:18.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:18.595 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:18.607 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:18.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:18.615 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:18.615 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:18.671 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:18.672 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:18.672 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:18.672 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:18.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:18.688 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:18.688 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:18.745 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:18.745 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:18.746 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:18.746 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:19.672 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:19.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:19.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:19.746 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:19.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:19.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:19.748 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:19.814 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:19.827 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:19.827 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:19.827 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:19.883 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:19.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:19.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:19.884 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:19.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:19.895 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:19.895 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:19.953 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:19.954 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:19.954 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:19.954 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:20.884 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:20.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:20.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:20.979 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:20.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:20.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:21.030 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:21.041 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:21.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:21.090 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:21.090 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:21.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:21.125 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:21.125 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:21.146 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:21.146 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:21.146 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:21.146 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:21.181 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:21.181 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:21.181 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:21.181 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:22.147 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:22.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:22.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:22.207 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:22.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:22.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:22.258 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:22.269 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:22.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:22.317 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:22.317 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:22.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:22.347 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:22.347 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:22.374 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:22.374 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:22.374 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:22.374 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:22.404 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:22.404 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:22.404 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:22.404 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:23.375 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:23.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:23.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:23.468 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:23.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:23.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:23.520 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:23.531 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:23.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:23.538 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:23.538 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:23.594 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:23.594 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:23.594 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:23.595 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:23.614 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:23.614 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:23.614 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:23.672 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:23.672 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:23.672 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:23.672 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:24.596 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:24.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:24.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:24.694 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:24.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:24.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:24.746 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:24.757 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:24.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:24.764 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:24.764 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:24.821 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:24.821 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:24.821 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:24.821 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:24.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:24.838 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:24.838 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:24.895 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:24.895 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:24.895 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:24.896 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:25.822 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:25.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:25.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:25.927 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:25.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:25.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:25.979 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:25.990 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:25.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:25.997 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:25.997 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:26.053 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:26.053 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:26.053 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:26.053 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:26.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:26.063 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:26.063 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:26.119 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:26.119 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:26.119 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:26.119 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:27.054 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:27.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:27.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:27.153 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:27.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:27.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:27.206 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:27.217 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:27.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:27.223 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:27.223 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:27.279 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:27.280 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.280 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:27.280 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:27.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:27.289 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:27.289 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:27.346 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:27.346 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.346 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:27.346 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:28.281 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:28.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:28.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:28.380 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:28.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:28.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:28.432 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:28.443 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:28.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:28.491 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:28.491 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:28.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:28.525 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:28.525 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:28.547 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:28.548 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:28.548 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:28.548 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:28.581 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:28.581 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:28.582 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:28.582 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:29.549 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:29.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:29.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:29.625 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:29.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:29.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:29.677 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:29.688 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:29.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:29.735 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:29.735 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:29.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:29.779 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:29.779 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:29.793 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:29.793 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:29.793 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:29.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:29.835 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:29.835 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:29.835 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:29.835 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:30.794 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:30.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:30.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:30.887 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:30.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:30.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:30.938 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:30.949 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:30.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:30.997 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:30.997 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:31.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:31.029 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:31.029 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:31.053 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:31.053 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:31.053 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:31.053 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:31.086 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:31.086 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:31.086 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:31.086 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:32.054 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:32.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:32.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:32.152 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:32.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:32.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:32.204 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:32.215 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:32.222 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:32.222 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:32.222 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:32.279 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:32.279 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:32.279 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:32.279 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:32.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:32.286 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:32.286 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:32.342 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:32.343 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:32.343 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:32.343 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:33.280 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:33.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:33.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:33.341 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:33.344 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:33.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:33.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:33.406 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:33.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:33.421 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:33.421 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:33.477 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:33.477 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:33.477 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:33.477 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:33.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:33.480 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:33.480 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:33.536 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:33.536 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:33.536 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:33.536 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:34.478 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:34.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:34.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:34.595 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:34.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:34.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:34.606 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:34.680 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:34.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:34.685 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:34.685 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:34.741 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:34.742 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:34.742 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:34.742 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:34.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:34.763 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:34.763 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:34.820 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:34.821 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:34.821 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:34.821 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:35.742 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:35.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:35.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:35.843 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:35.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:35.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:35.896 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:35.906 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:35.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:35.913 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:35.913 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:35.969 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:35.970 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:35.970 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:35.970 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:35.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:35.978 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:35.978 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:36.036 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:36.036 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:36.036 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:36.036 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:36.970 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:36.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:36.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:37.069 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:37.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:37.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:37.121 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:37.132 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:37.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:37.139 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:37.139 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:37.195 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:37.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:37.196 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:37.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:37.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:37.206 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:37.206 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:37.263 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:37.263 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:37.263 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:37.263 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:38.196 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:38.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:38.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:38.296 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:38.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:38.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:38.347 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:38.358 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:38.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:38.365 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:38.365 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:38.422 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:38.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:38.422 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:38.422 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:38.436 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:38.436 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:38.436 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:38.493 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:38.493 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:38.493 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:38.493 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:39.423 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:39.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:39.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:39.521 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:39.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:39.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:39.574 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:39.585 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:39.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:39.632 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:39.632 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:39.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:39.671 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:39.671 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:39.688 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:39.688 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:39.689 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:39.689 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:39.728 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:39.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:39.728 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:39.729 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:40.690 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:40.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:40.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:40.791 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:40.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:40.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:40.843 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:40.854 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:40.861 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:40.861 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:40.861 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:40.917 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:40.917 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:40.917 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:40.917 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:40.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:40.934 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:40.934 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:40.991 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:40.991 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:40.991 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:40.991 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:41.918 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:41.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:41.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:42.036 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:42.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:42.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:42.048 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:42.106 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:42.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:42.129 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:42.129 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:42.179 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:42.179 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:42.179 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:42.186 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:42.187 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:42.187 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:42.187 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:42.237 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:42.237 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:42.237 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:42.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:43.188 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:43.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:43.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:43.309 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:43.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:43.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:43.320 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:43.373 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:43.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:43.398 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:43.398 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:43.455 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:43.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:43.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:43.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:43.459 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:43.460 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:43.460 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:43.516 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:43.517 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:43.517 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:43.517 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:44.456 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:44.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:44.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:44.554 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:44.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:44.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:44.605 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:44.616 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:44.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:44.664 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:44.664 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:44.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:44.701 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:44.702 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:44.721 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:44.722 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:44.722 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:44.722 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:44.758 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:44.758 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:44.758 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:44.758 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:45.723 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:45.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:45.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:45.760 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:45.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:45.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:45.909 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:45.910 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:45.983 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:45.983 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:45.983 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:45.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:45.994 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:45.994 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:46.040 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:46.040 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:46.040 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:46.041 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:46.052 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:46.052 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:46.053 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:46.053 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:47.042 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:47.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:47.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:47.140 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:47.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:47.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:47.193 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:47.203 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:47.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:47.211 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:47.211 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:47.267 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:47.267 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:47.267 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:47.267 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:47.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:47.290 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:47.290 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:47.348 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:47.348 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:47.348 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:47.348 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:48.268 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:48.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:48.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:48.368 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:48.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:48.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:48.420 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:48.431 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:48.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:48.476 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:48.476 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:48.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:48.512 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:48.512 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:48.534 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:48.534 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:48.534 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:48.534 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:48.569 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:48.569 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:48.569 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:48.569 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:49.535 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:49.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:49.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:49.593 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:49.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:49.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:49.644 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:49.655 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:49.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:49.662 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:49.662 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:49.718 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:49.718 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:49.718 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:49.718 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:49.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:49.732 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:49.732 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:49.788 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:49.789 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:49.789 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:49.789 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:50.720 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:50.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:50.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:50.819 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:50.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:50.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:50.870 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:50.881 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:50.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:50.926 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:50.927 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:50.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:50.960 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:50.960 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:50.983 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:50.984 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:50.984 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:50.984 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:51.017 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:51.017 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:51.017 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:51.017 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:51.984 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:51.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:51.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:52.083 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:52.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:52.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:52.164 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:52.176 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:52.183 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:52.183 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:52.184 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:52.240 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:52.240 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:52.240 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:52.240 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:52.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:52.261 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:52.261 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:52.319 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:52.319 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:52.319 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:52.319 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:53.241 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:53.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:53.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:53.340 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:53.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:53.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:53.392 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:53.403 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:53.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:53.410 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:53.410 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:53.467 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:53.467 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:53.467 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:53.467 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:53.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:53.488 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:53.489 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:53.545 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:53.546 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:53.546 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:53.546 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:54.469 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:54.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:54.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:54.567 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:54.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:54.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:54.619 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:54.630 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:54.636 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:54.636 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:54.636 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:54.693 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:54.693 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:54.694 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:54.694 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:54.707 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:54.707 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:54.707 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:54.763 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:54.764 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:54.764 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:54.764 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:55.695 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:55.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:55.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:55.793 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:55.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:55.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:55.845 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:55.856 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:55.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:55.904 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:55.904 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:55.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:55.934 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:55.935 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:55.960 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:55.960 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:55.960 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:55.960 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:55.991 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:55.991 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:55.991 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:55.991 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:56.962 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:56.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:56.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:57.060 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:57.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:57.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:57.111 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:57.122 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:57.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:57.129 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:57.129 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:57.185 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:57.185 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:57.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:57.185 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:57.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:57.204 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:57.204 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:57.262 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:57.262 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:57.262 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:57.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:58.186 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:58.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:58.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:58.285 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:58.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:58.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:58.337 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:58.349 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:58.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:58.355 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:58.355 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:58.411 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:58.411 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:58.411 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:58.411 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:58.424 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:58.424 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:58.424 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:58.482 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:58.482 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:58.482 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:58.482 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:59.412 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:50:59.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:59.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:59.510 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:50:59.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:59.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:59.562 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:50:59.572 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:50:59.579 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:50:59.579 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:59.579 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:50:59.635 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:59.636 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:59.636 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:59.636 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:59.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:50:59.652 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:59.652 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:50:59.709 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:59.709 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:59.710 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:59.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:00.636 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:00.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:00.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:00.734 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:00.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:00.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:00.787 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:00.797 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:00.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:00.804 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:00.804 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:00.861 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:00.861 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:00.862 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:00.862 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:00.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:00.877 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:00.877 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:00.934 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:00.934 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:00.934 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:00.934 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:01.863 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:01.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:01.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:01.961 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:01.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:01.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:02.014 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:02.025 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:02.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:02.031 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:02.031 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:02.088 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:02.088 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:02.088 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:02.088 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:02.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:02.108 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:02.108 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:02.166 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:02.166 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:02.166 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:02.166 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:03.089 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:03.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:03.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:03.168 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:03.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:03.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:03.175 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:03.230 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:03.253 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:03.253 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:03.253 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:03.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:03.306 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:03.306 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:03.309 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:03.309 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:03.309 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:03.309 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:03.364 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:03.364 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:03.364 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:03.365 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:04.310 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:04.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:04.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:04.431 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:04.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:04.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:04.442 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:04.494 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:04.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:04.527 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:04.527 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:04.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:04.584 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:04.584 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:04.585 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:04.586 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:04.586 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:04.586 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:04.641 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:04.642 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:04.642 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:04.642 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:05.587 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:05.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:05.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:05.685 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:05.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:05.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:05.737 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:05.747 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:05.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:05.795 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:05.795 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:05.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:05.823 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:05.823 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:05.852 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:05.853 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:05.853 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:05.853 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:05.881 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:05.881 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:05.881 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:05.881 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:06.854 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:06.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:06.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:06.968 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:06.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:06.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:06.978 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:07.052 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:07.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:07.063 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:07.063 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:07.119 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:07.119 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:07.119 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:07.120 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:07.120 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:07.120 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:07.120 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:07.176 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:07.177 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:07.177 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:07.177 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:08.121 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:08.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:08.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:08.219 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:08.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:08.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:08.271 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:08.282 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:08.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:08.289 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:08.289 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:08.346 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:08.346 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:08.346 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:08.346 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:08.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:08.364 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:08.364 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:08.420 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:08.421 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:08.421 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:08.421 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:09.348 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:09.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:09.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:09.447 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:09.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:09.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:09.500 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:09.511 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:09.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:09.518 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:09.518 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:09.576 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:09.576 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:09.576 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:09.576 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:09.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:09.585 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:09.585 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:09.642 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:09.642 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:09.643 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:09.643 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:10.577 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:10.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:10.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:10.676 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:10.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:10.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:10.729 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:10.740 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:10.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:10.747 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:10.747 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:10.803 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:10.804 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:10.804 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:10.804 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:10.819 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:10.819 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:10.819 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:10.877 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:10.877 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:10.877 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:10.877 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:11.805 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:11.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:11.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:11.873 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:11.879 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:11.879 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:11.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:11.945 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:11.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:11.953 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:11.953 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:12.010 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:12.011 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:12.011 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:12.011 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:12.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:12.031 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:12.031 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:12.089 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:12.089 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:12.089 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:12.089 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:13.012 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:13.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:13.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:13.111 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:13.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:13.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:13.163 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:13.174 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:13.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:13.181 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:13.181 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:13.237 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:13.237 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:13.237 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:13.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:13.251 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:13.251 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:13.251 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:13.309 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:13.309 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:13.310 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:13.310 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:14.239 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:14.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:14.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:14.321 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:14.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:14.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:14.372 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:14.383 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:14.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:14.431 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:14.431 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:14.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:14.461 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:14.461 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:14.487 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:14.488 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:14.488 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:14.488 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:14.518 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:14.518 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:14.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:14.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:15.488 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:15.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:15.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:15.586 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:15.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:15.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:15.639 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:15.649 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:15.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:15.656 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:15.656 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:15.712 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:15.713 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:15.713 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:15.713 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:15.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:15.729 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:15.729 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:15.786 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:15.787 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:15.787 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:15.787 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:16.713 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:16.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:16.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:16.811 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:16.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:16.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:16.863 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:16.874 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:16.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:16.880 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:16.880 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:16.937 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:16.937 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:16.937 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:16.937 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:16.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:16.955 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:16.955 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:17.012 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:17.012 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:17.012 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:17.012 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:17.938 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:17.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:17.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:18.058 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:18.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:18.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:18.069 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:18.125 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:18.151 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:18.151 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:18.151 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:18.208 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:18.208 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:18.208 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:18.208 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:18.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:18.211 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:18.211 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:18.268 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:18.268 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:18.268 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:18.268 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:19.210 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:19.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:19.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:19.309 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:19.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:19.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:19.361 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:19.372 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:19.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:19.420 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:19.420 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:19.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:19.464 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:19.464 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:19.477 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:19.477 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:19.477 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:19.477 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:19.521 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:19.521 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:19.522 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:19.522 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:20.478 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:20.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:20.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:20.577 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:20.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:20.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:20.629 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:20.640 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:20.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:20.647 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:20.647 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:20.703 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:20.703 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:20.703 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:20.723 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:20.723 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:20.723 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:20.780 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:20.780 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.780 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:20.780 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:21.704 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:21.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:21.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:21.829 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:21.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:21.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:21.839 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:21.891 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:21.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:21.928 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:21.928 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:21.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:21.970 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:21.971 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:21.985 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:21.985 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:21.985 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:21.985 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:22.028 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:22.028 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:22.029 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:22.029 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:22.986 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:22.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:22.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:23.085 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:23.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:23.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:23.137 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:23.147 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:23.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:23.194 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:23.194 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:23.227 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:23.227 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:23.227 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:23.250 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:23.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:23.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:23.250 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:23.283 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:23.283 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:23.283 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:23.283 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:24.251 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:24.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:24.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:24.321 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:24.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:24.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:24.381 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:24.393 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:24.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:24.399 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:24.399 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:24.457 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:24.457 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:24.457 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:24.457 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:24.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:24.474 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:24.474 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:24.531 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:24.531 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:24.531 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:24.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:25.457 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:25.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:25.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:25.556 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:25.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:25.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:25.608 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:25.618 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:25.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:25.624 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:25.625 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:25.681 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:25.681 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:25.681 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:25.681 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:25.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:25.705 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:25.705 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:25.763 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:25.764 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:25.764 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:25.764 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:26.682 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:26.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:26.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:26.781 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:26.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:26.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:26.834 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:26.844 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:26.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:26.851 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:26.851 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:26.907 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:26.908 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:26.908 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:26.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:26.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:26.921 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:26.921 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:26.978 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:26.978 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:26.978 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:26.978 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:27.908 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:27.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:27.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:28.007 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:28.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:28.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:28.059 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:28.070 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:28.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:28.076 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:28.077 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:28.133 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:28.133 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:28.133 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:28.134 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:28.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:28.145 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:28.145 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:28.203 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:28.203 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:28.204 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:28.204 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:29.134 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:29.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:29.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:29.232 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:29.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:29.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:29.284 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:29.295 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:29.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:29.304 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:29.304 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:29.360 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:29.361 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:29.361 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:29.361 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:29.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:29.385 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:29.385 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:29.442 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:29.442 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:29.442 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:29.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:30.361 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:30.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:30.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:30.459 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:30.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:30.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:30.511 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:30.522 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:30.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:30.570 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:30.571 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:30.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:30.608 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:30.609 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:30.627 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:30.627 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:30.627 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:30.627 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:30.666 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:30.666 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:30.666 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:30.666 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:31.628 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:31.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:31.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:31.724 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:31.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:31.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:31.775 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:31.785 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:31.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:31.833 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:31.833 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:31.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:31.869 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:31.869 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:31.890 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:31.890 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:31.890 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:31.890 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:31.926 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:31.926 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:31.926 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:31.926 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:32.891 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:32.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:32.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:32.989 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:32.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:32.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:33.042 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:33.053 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:33.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:33.060 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:33.060 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:33.118 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:33.118 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:33.118 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:33.118 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:33.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:33.143 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:33.143 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:33.200 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:33.200 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:33.200 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:33.200 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:34.119 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:34.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:34.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:34.216 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:34.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:34.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:34.268 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:34.279 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:34.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:34.285 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:34.286 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:34.344 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:34.344 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:34.344 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:34.345 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:34.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:34.366 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:34.366 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:34.423 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:34.423 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:34.424 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:34.424 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:35.346 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:35.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:35.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:35.443 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:35.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:35.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:35.495 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:35.506 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:35.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:35.513 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:35.513 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:35.569 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:35.570 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:35.570 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:35.570 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:35.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:35.582 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:35.582 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:35.640 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:35.640 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:35.640 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:35.640 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:36.571 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:36.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:36.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:36.641 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:36.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:36.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:36.648 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:36.709 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:36.728 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:36.728 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:36.728 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:36.785 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:36.785 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:36.785 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:36.785 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:36.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:36.789 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:36.789 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:36.846 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:36.846 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:36.846 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:36.846 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:37.786 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:37.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:37.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:37.872 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:37.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:37.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:37.924 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:37.935 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:37.942 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:37.942 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:37.942 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:37.998 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:37.998 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:37.998 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:37.998 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:38.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:38.019 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:38.019 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:38.075 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:38.075 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:38.075 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:38.075 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:38.998 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:38.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:39.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:39.085 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:39.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:39.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:39.136 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:39.147 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:39.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:39.195 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:39.195 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:39.233 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:39.233 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:39.233 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:39.253 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:39.253 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:39.253 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:39.253 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:39.289 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:39.289 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:39.290 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:39.290 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:40.254 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:40.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:40.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:40.353 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:40.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:40.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:40.406 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:40.417 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:40.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:40.423 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:40.423 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:40.479 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:40.480 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:40.480 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:40.480 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:40.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:40.489 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:40.489 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:40.546 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:40.547 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:40.547 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:40.547 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:41.481 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:41.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:41.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:41.579 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:41.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:41.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:41.631 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:41.642 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:41.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:41.648 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:41.649 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:41.705 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:41.705 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:41.706 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:41.706 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:41.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:41.722 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:41.722 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:41.779 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:41.779 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:41.779 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:41.779 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:42.707 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:42.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:42.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:42.805 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:42.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:42.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:42.857 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:42.868 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:42.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:42.874 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:42.874 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:42.932 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:42.932 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:42.932 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:42.932 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:42.947 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:42.947 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:42.947 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:43.003 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:43.004 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:43.004 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:43.004 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:43.933 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:43.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:43.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:44.031 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:44.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:44.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:44.083 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:44.095 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:44.142 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:44.142 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:44.143 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:44.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:44.170 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:44.170 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:44.199 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:44.200 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:44.200 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:44.200 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:44.227 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:44.227 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:44.227 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:44.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:45.201 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:45.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:45.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:45.291 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:45.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:45.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:45.343 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:45.353 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:45.360 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:45.360 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:45.360 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:45.416 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:45.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:45.416 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:45.416 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:45.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:45.426 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:45.426 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:45.484 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:45.484 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:45.484 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:45.484 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:46.418 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:46.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:46.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:46.495 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:46.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:46.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:46.547 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:46.558 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:46.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:46.606 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:46.606 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:46.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:46.637 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:46.637 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:46.662 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:46.663 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:46.663 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:46.663 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:46.694 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:46.694 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:46.694 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:46.694 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:47.663 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:47.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:47.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:47.762 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:47.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:47.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:47.815 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:47.825 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:47.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:47.832 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:47.832 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:47.889 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:47.889 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:47.889 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:47.889 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:47.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:47.907 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:47.907 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:47.964 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:47.965 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:47.965 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:47.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:48.890 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:48.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:48.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:48.987 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:48.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:48.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:49.039 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:49.050 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:49.057 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:49.057 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:49.057 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:49.113 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:49.114 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:49.114 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:49.114 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:49.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:49.129 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:49.129 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:49.187 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:49.188 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:49.188 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:49.188 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:50.115 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:50.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:50.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:50.189 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:50.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:50.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:50.195 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:50.254 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:50.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:50.270 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:50.271 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:50.327 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:50.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:50.327 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:50.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:50.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:50.343 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:50.343 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:50.401 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:50.401 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:50.401 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:50.401 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:51.328 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:51.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:51.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:51.427 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:51.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:51.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:51.479 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:51.490 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:51.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:51.497 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:51.497 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:51.553 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:51.553 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:51.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:51.554 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:51.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:51.566 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:51.566 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:51.623 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:51.623 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:51.624 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:51.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:52.554 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:52.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:52.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:52.624 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:52.625 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:52.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:52.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:52.688 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:52.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:52.709 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:52.709 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:52.765 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:52.765 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:52.765 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:52.766 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:52.766 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:52.766 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:52.766 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:52.822 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:52.822 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:52.822 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:52.823 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:53.767 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:53.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:53.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:53.867 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:53.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:53.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:53.918 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:53.929 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:53.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:53.978 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:53.978 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:54.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:54.002 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:54.002 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:54.034 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:54.034 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:54.035 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:54.035 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:54.058 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:54.058 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:54.058 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:54.058 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:55.036 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:55.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:55.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:55.133 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:55.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:55.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:55.186 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:55.197 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:55.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:55.204 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:55.205 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:55.261 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:55.262 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:55.262 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:55.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:55.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:55.272 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:55.272 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:55.329 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:55.330 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:55.330 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:55.330 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:56.262 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:56.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:56.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:56.359 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:56.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:56.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:56.411 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:56.422 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:56.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:56.469 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:56.469 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:56.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:56.495 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:56.495 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:56.525 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:56.525 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:56.525 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:56.525 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:56.551 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:56.551 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:56.551 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:56.551 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:57.526 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:57.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:57.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:57.624 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:57.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:57.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:57.676 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:57.687 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:57.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:57.735 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:57.735 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:57.765 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:57.765 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:57.765 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:57.791 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:57.792 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:57.792 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:57.792 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:57.821 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:57.821 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:57.821 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:57.821 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:58.792 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:51:58.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:58.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:58.891 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:51:58.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:58.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:58.943 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:51:58.954 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:51:58.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:51:58.961 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:58.961 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:51:59.017 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:59.018 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:59.018 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:59.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:59.044 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:51:59.044 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:59.044 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:51:59.102 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:59.102 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:59.102 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:59.102 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:00.019 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:52:00.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:52:00.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:00.118 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:52:00.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:52:00.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:00.170 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:52:00.181 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:52:00.187 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:52:00.187 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:00.187 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:52:00.244 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:00.244 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:00.245 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:00.245 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:00.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:52:00.269 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:00.269 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:52:00.326 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:00.326 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:00.326 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:00.326 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:01.246 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:52:01.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:52:01.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:01.345 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:52:01.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:52:01.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:01.397 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-12T22:52:01.407 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-12T22:52:01.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-12T22:52:01.455 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:01.455 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-12T22:52:01.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-12T22:52:01.491 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:01.491 DEBUG:teuthology.orchestra.run.trial158:> uname -r 2026-02-12T22:52:01.513 INFO:teuthology.orchestra.run.trial138.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:01.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:01.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:01.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:01.514 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:01.516 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:52:01.527 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:52:01.558 INFO:teuthology.run:Summary data: description: fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/truncate_delay} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:52:01.558 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:52:01.638 INFO:teuthology.orchestra.run.trial158.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:01.639 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:01.639 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:01.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:01.697 INFO:teuthology.run:FAIL