2026-02-12T22:47:27.782 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:47:27.800 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:47:27.880 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47302 branch: wip-pdonnell-testing-20260210.171210 description: fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/rpm_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47302' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMZ7LkNE0/p9DX60+b741PfpDUBDAI+LLWNaZku+PFOeF7g2FP4XwPiHVeP64q3qjD5ylpmgyTJHs34RyAJDqN4= trial160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNUV8hVV7dQlG77wDxh6hOwnGLGm8wMbJ/2JzifOIyA3I7kHEVFxGZMHU7cAKMNRNLDQmZKFHfDBgVTiykb2X3A= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_cephfs_shell teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:47:27.880 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:47:27.880 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:47:27.880 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:47:27.882 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:47:27.882 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:47:27.882 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:47:27.882 INFO:teuthology.packaging:ref: None 2026-02-12T22:47:27.882 INFO:teuthology.packaging:tag: None 2026-02-12T22:47:27.882 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:47:27.882 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:47:27.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:47:27.995 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:47:27.996 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:47:28.007 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:47:28.007 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:47:28.020 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:47:28.036 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:47:28.047 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:47:28.120 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial026.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47302', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:44:04.257890', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMZ7LkNE0/p9DX60+b741PfpDUBDAI+LLWNaZku+PFOeF7g2FP4XwPiHVeP64q3qjD5ylpmgyTJHs34RyAJDqN4='} 2026-02-12T22:47:28.176 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial160.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47302', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:44:04.258530', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNUV8hVV7dQlG77wDxh6hOwnGLGm8wMbJ/2JzifOIyA3I7kHEVFxGZMHU7cAKMNRNLDQmZKFHfDBgVTiykb2X3A='} 2026-02-12T22:47:28.176 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:47:28.187 INFO:teuthology.task.internal:roles: ubuntu@trial026.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-12T22:47:28.187 INFO:teuthology.task.internal:roles: ubuntu@trial160.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2026-02-12T22:47:28.188 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:47:28.323 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x763d047ca980>, signals=[15]) 2026-02-12T22:47:28.323 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:47:28.334 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:47:28.334 DEBUG:teuthology.task.internal:connecting to ubuntu@trial026.front.sepia.ceph.com 2026-02-12T22:47:28.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:28.393 DEBUG:teuthology.task.internal:connecting to ubuntu@trial160.front.sepia.ceph.com 2026-02-12T22:47:28.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:28.453 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:47:28.465 DEBUG:teuthology.orchestra.run.trial026:> uname -m 2026-02-12T22:47:28.482 INFO:teuthology.orchestra.run.trial026.stdout:x86_64 2026-02-12T22:47:28.482 DEBUG:teuthology.orchestra.run.trial026:> cat /etc/os-release 2026-02-12T22:47:28.540 INFO:teuthology.orchestra.run.trial026.stdout:NAME="Rocky Linux" 2026-02-12T22:47:28.540 INFO:teuthology.orchestra.run.trial026.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:47:28.540 INFO:teuthology.orchestra.run.trial026.stdout:ID="rocky" 2026-02-12T22:47:28.540 INFO:teuthology.orchestra.run.trial026.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:47:28.540 INFO:teuthology.orchestra.run.trial026.stdout:VERSION_ID="10.1" 2026-02-12T22:47:28.540 INFO:teuthology.orchestra.run.trial026.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:47:28.540 INFO:teuthology.orchestra.run.trial026.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:47:28.540 INFO:teuthology.orchestra.run.trial026.stdout:ANSI_COLOR="0;32" 2026-02-12T22:47:28.540 INFO:teuthology.orchestra.run.trial026.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:47:28.540 INFO:teuthology.orchestra.run.trial026.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:47:28.540 INFO:teuthology.orchestra.run.trial026.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:47:28.540 INFO:teuthology.orchestra.run.trial026.stdout:VENDOR_NAME="RESF" 2026-02-12T22:47:28.540 INFO:teuthology.orchestra.run.trial026.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:47:28.540 INFO:teuthology.orchestra.run.trial026.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:47:28.540 INFO:teuthology.orchestra.run.trial026.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:47:28.541 INFO:teuthology.orchestra.run.trial026.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:47:28.541 INFO:teuthology.orchestra.run.trial026.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:47:28.541 INFO:teuthology.orchestra.run.trial026.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:47:28.541 INFO:teuthology.orchestra.run.trial026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:47:28.541 INFO:teuthology.lock.ops:Updating trial026.front.sepia.ceph.com on lock server 2026-02-12T22:47:28.615 DEBUG:teuthology.orchestra.run.trial160:> uname -m 2026-02-12T22:47:28.632 INFO:teuthology.orchestra.run.trial160.stdout:x86_64 2026-02-12T22:47:28.633 DEBUG:teuthology.orchestra.run.trial160:> cat /etc/os-release 2026-02-12T22:47:28.689 INFO:teuthology.orchestra.run.trial160.stdout:NAME="Rocky Linux" 2026-02-12T22:47:28.689 INFO:teuthology.orchestra.run.trial160.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:47:28.689 INFO:teuthology.orchestra.run.trial160.stdout:ID="rocky" 2026-02-12T22:47:28.689 INFO:teuthology.orchestra.run.trial160.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:47:28.690 INFO:teuthology.orchestra.run.trial160.stdout:VERSION_ID="10.1" 2026-02-12T22:47:28.690 INFO:teuthology.orchestra.run.trial160.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:47:28.690 INFO:teuthology.orchestra.run.trial160.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:47:28.690 INFO:teuthology.orchestra.run.trial160.stdout:ANSI_COLOR="0;32" 2026-02-12T22:47:28.690 INFO:teuthology.orchestra.run.trial160.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:47:28.690 INFO:teuthology.orchestra.run.trial160.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:47:28.690 INFO:teuthology.orchestra.run.trial160.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:47:28.690 INFO:teuthology.orchestra.run.trial160.stdout:VENDOR_NAME="RESF" 2026-02-12T22:47:28.690 INFO:teuthology.orchestra.run.trial160.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:47:28.690 INFO:teuthology.orchestra.run.trial160.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:47:28.690 INFO:teuthology.orchestra.run.trial160.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:47:28.690 INFO:teuthology.orchestra.run.trial160.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:47:28.690 INFO:teuthology.orchestra.run.trial160.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:47:28.690 INFO:teuthology.orchestra.run.trial160.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:47:28.690 INFO:teuthology.orchestra.run.trial160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:47:28.690 INFO:teuthology.lock.ops:Updating trial160.front.sepia.ceph.com on lock server 2026-02-12T22:47:28.767 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:47:28.782 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:47:28.793 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:47:28.793 DEBUG:teuthology.orchestra.run.trial026:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:47:28.795 DEBUG:teuthology.orchestra.run.trial160:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:47:28.812 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:47:28.824 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:47:28.824 DEBUG:teuthology.orchestra.run.trial026:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:47:28.853 DEBUG:teuthology.orchestra.run.trial160:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:47:28.868 INFO:teuthology.orchestra.run.trial026.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:47:28.870 INFO:teuthology.orchestra.run.trial160.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:47:28.871 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:47:29.044 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:47:29.064 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:47:29.064 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:47:29.065 DEBUG:teuthology.orchestra.run.trial026:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:47:29.065 DEBUG:teuthology.orchestra.run.trial160:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:47:29.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:47:29.081 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:47:29.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:47:29.081 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:47:29.138 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:29.138 INFO:teuthology.task.kernel:Running kernel on trial160: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:29.138 DEBUG:teuthology.orchestra.run.trial160:> sudo yum install -y kernel 2026-02-12T22:47:29.139 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:29.139 INFO:teuthology.task.kernel:Running kernel on trial026: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:29.139 DEBUG:teuthology.orchestra.run.trial026:> sudo yum install -y kernel 2026-02-12T22:47:29.633 INFO:teuthology.orchestra.run.trial160.stdout:Rocky Linux 10 - AppStream 24 MB/s | 2.2 MB 00:00 2026-02-12T22:47:29.649 INFO:teuthology.orchestra.run.trial026.stdout:Rocky Linux 10 - AppStream 21 MB/s | 2.2 MB 00:00 2026-02-12T22:47:29.966 INFO:teuthology.orchestra.run.trial026.stdout:Rocky Linux 10 - BaseOS 58 MB/s | 11 MB 00:00 2026-02-12T22:47:29.966 INFO:teuthology.orchestra.run.trial160.stdout:Rocky Linux 10 - BaseOS 52 MB/s | 11 MB 00:00 2026-02-12T22:47:30.455 INFO:teuthology.orchestra.run.trial026.stdout:Rocky Linux 10 - CRB 6.1 MB/s | 507 kB 00:00 2026-02-12T22:47:30.460 INFO:teuthology.orchestra.run.trial160.stdout:Rocky Linux 10 - CRB 5.4 MB/s | 507 kB 00:00 2026-02-12T22:47:30.724 INFO:teuthology.orchestra.run.trial160.stdout:Extra Packages for Enterprise Linux 29 MB/s | 6.2 MB 00:00 2026-02-12T22:47:30.917 INFO:teuthology.orchestra.run.trial026.stdout:Extra Packages for Enterprise Linux 15 MB/s | 6.2 MB 00:00 2026-02-12T22:47:31.393 INFO:teuthology.orchestra.run.trial160.stdout:lab-extras 176 kB/s | 3.7 kB 00:00 2026-02-12T22:47:31.588 INFO:teuthology.orchestra.run.trial026.stdout:lab-extras 297 kB/s | 3.7 kB 00:00 2026-02-12T22:47:31.803 INFO:teuthology.orchestra.run.trial160.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:47:31.814 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-12T22:47:31.816 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-12T22:47:31.816 INFO:teuthology.orchestra.run.trial160.stdout: Package Arch Version Repo Size 2026-02-12T22:47:31.816 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-12T22:47:31.816 INFO:teuthology.orchestra.run.trial160.stdout:Installing: 2026-02-12T22:47:31.816 INFO:teuthology.orchestra.run.trial160.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:47:31.816 INFO:teuthology.orchestra.run.trial160.stdout:Installing dependencies: 2026-02-12T22:47:31.816 INFO:teuthology.orchestra.run.trial160.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:47:31.816 INFO:teuthology.orchestra.run.trial160.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:47:31.816 INFO:teuthology.orchestra.run.trial160.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:47:31.816 INFO:teuthology.orchestra.run.trial160.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:47:31.817 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T22:47:31.817 INFO:teuthology.orchestra.run.trial160.stdout:Transaction Summary 2026-02-12T22:47:31.817 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-12T22:47:31.817 INFO:teuthology.orchestra.run.trial160.stdout:Install 5 Packages 2026-02-12T22:47:31.817 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T22:47:31.817 INFO:teuthology.orchestra.run.trial160.stdout:Total download size: 93 M 2026-02-12T22:47:31.817 INFO:teuthology.orchestra.run.trial160.stdout:Installed size: 135 M 2026-02-12T22:47:31.817 INFO:teuthology.orchestra.run.trial160.stdout:Downloading Packages: 2026-02-12T22:47:31.871 INFO:teuthology.orchestra.run.trial160.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 25 MB/s | 1.4 MB 00:00 2026-02-12T22:47:31.995 INFO:teuthology.orchestra.run.trial026.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:47:32.007 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-12T22:47:32.008 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-12T22:47:32.008 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-12T22:47:32.008 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-12T22:47:32.008 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-12T22:47:32.008 INFO:teuthology.orchestra.run.trial026.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:47:32.008 INFO:teuthology.orchestra.run.trial026.stdout:Installing dependencies: 2026-02-12T22:47:32.008 INFO:teuthology.orchestra.run.trial026.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:47:32.009 INFO:teuthology.orchestra.run.trial026.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:47:32.009 INFO:teuthology.orchestra.run.trial026.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:47:32.009 INFO:teuthology.orchestra.run.trial026.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:47:32.009 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-12T22:47:32.009 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-12T22:47:32.009 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-12T22:47:32.009 INFO:teuthology.orchestra.run.trial026.stdout:Install 5 Packages 2026-02-12T22:47:32.009 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-12T22:47:32.009 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 93 M 2026-02-12T22:47:32.009 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 135 M 2026-02-12T22:47:32.009 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-12T22:47:32.058 INFO:teuthology.orchestra.run.trial026.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 28 MB/s | 1.4 MB 00:00 2026-02-12T22:47:32.087 INFO:teuthology.orchestra.run.trial160.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 68 MB/s | 18 MB 00:00 2026-02-12T22:47:32.138 INFO:teuthology.orchestra.run.trial160.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 55 MB/s | 2.8 MB 00:00 2026-02-12T22:47:32.322 INFO:teuthology.orchestra.run.trial160.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 65 MB/s | 30 MB 00:00 2026-02-12T22:47:32.344 INFO:teuthology.orchestra.run.trial026.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 55 MB/s | 18 MB 00:00 2026-02-12T22:47:32.429 INFO:teuthology.orchestra.run.trial026.stdout:(3/5): kernel-modules-core-6.12.0-124.31.1.el10 80 MB/s | 30 MB 00:00 2026-02-12T22:47:32.433 INFO:teuthology.orchestra.run.trial026.stdout:(4/5): kernel-modules-extra-6.12.0-124.31.1.el1 32 MB/s | 2.8 MB 00:00 2026-02-12T22:47:32.468 INFO:teuthology.orchestra.run.trial160.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 62 MB/s | 41 MB 00:00 2026-02-12T22:47:32.469 INFO:teuthology.orchestra.run.trial160.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:47:32.469 INFO:teuthology.orchestra.run.trial160.stdout:Total 142 MB/s | 93 MB 00:00 2026-02-12T22:47:32.469 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction check 2026-02-12T22:47:32.615 INFO:teuthology.orchestra.run.trial026.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 67 MB/s | 41 MB 00:00 2026-02-12T22:47:32.616 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:47:32.616 INFO:teuthology.orchestra.run.trial026.stdout:Total 153 MB/s | 93 MB 00:00 2026-02-12T22:47:32.616 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-12T22:47:32.616 INFO:teuthology.orchestra.run.trial160.stdout:Transaction check succeeded. 2026-02-12T22:47:32.617 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction test 2026-02-12T22:47:32.762 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-12T22:47:32.762 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-12T22:47:33.017 INFO:teuthology.orchestra.run.trial160.stdout:Transaction test succeeded. 2026-02-12T22:47:33.018 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction 2026-02-12T22:47:33.164 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-12T22:47:33.164 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-12T22:47:33.713 INFO:teuthology.orchestra.run.trial160.stdout: Preparing : 1/1 2026-02-12T22:47:33.857 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-12T22:47:33.914 INFO:teuthology.orchestra.run.trial160.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:47:33.936 INFO:teuthology.orchestra.run.trial160.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:47:34.059 INFO:teuthology.orchestra.run.trial026.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:47:34.080 INFO:teuthology.orchestra.run.trial026.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:47:35.196 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:47:35.223 INFO:teuthology.orchestra.run.trial160.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:47:35.333 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:47:35.361 INFO:teuthology.orchestra.run.trial026.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:47:37.068 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:47:37.073 INFO:teuthology.orchestra.run.trial160.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:47:37.206 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:47:37.211 INFO:teuthology.orchestra.run.trial026.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:47:38.934 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:47:38.944 INFO:teuthology.orchestra.run.trial160.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:47:39.070 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:47:39.080 INFO:teuthology.orchestra.run.trial026.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:47:40.812 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:47:40.942 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:14.521 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:14.545 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:14.712 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:14.736 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:14.778 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:14.778 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T22:48:14.778 INFO:teuthology.orchestra.run.trial160.stdout:Installed: 2026-02-12T22:48:14.778 INFO:teuthology.orchestra.run.trial160.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.778 INFO:teuthology.orchestra.run.trial160.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.778 INFO:teuthology.orchestra.run.trial160.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.778 INFO:teuthology.orchestra.run.trial160.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.779 INFO:teuthology.orchestra.run.trial160.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.779 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T22:48:14.779 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-12T22:48:14.843 DEBUG:teuthology.orchestra.run.trial160:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:48:14.878 INFO:teuthology.orchestra.run.trial160.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.879 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.880 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.880 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:48:14.880 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:48:14.880 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:48:14.880 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial160.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:48:14.880 DEBUG:teuthology.orchestra.run.trial160:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:48:14.952 INFO:teuthology.orchestra.run.trial160.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.953 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.953 DEBUG:teuthology.orchestra.run.trial160:> sudo rpm -qi grub2-tools 2026-02-12T22:48:14.971 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:14.971 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-12T22:48:14.972 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-12T22:48:14.972 INFO:teuthology.orchestra.run.trial026.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.972 INFO:teuthology.orchestra.run.trial026.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.972 INFO:teuthology.orchestra.run.trial026.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.972 INFO:teuthology.orchestra.run.trial026.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.972 INFO:teuthology.orchestra.run.trial026.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:14.972 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-12T22:48:14.973 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-12T22:48:15.023 INFO:teuthology.orchestra.run.trial160.stdout:Name : grub2-tools 2026-02-12T22:48:15.023 INFO:teuthology.orchestra.run.trial160.stdout:Epoch : 1 2026-02-12T22:48:15.023 INFO:teuthology.orchestra.run.trial160.stdout:Version : 2.12 2026-02-12T22:48:15.023 INFO:teuthology.orchestra.run.trial160.stdout:Release : 29.el10_1 2026-02-12T22:48:15.023 INFO:teuthology.orchestra.run.trial160.stdout:Architecture: x86_64 2026-02-12T22:48:15.023 INFO:teuthology.orchestra.run.trial160.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:Group : Unspecified 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:Size : 7963769 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:License : GPL-3.0-or-later 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:Signature : 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:Packager : Release Engineering 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:Summary : Support tools for GRUB. 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:Description : 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:hardware devices. 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-12T22:48:15.024 INFO:teuthology.orchestra.run.trial160.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:48:15.025 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:48:15.025 INFO:teuthology.task.kernel:Updating grub on trial160 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:15.025 DEBUG:teuthology.orchestra.run.trial160:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:48:15.036 DEBUG:teuthology.orchestra.run.trial026:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:48:15.069 INFO:teuthology.orchestra.run.trial026.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:15.070 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:15.070 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:15.070 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:48:15.071 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:48:15.071 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:48:15.071 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial026.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:48:15.071 DEBUG:teuthology.orchestra.run.trial026:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:48:15.091 INFO:teuthology.orchestra.run.trial160.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:48:15.092 DEBUG:teuthology.orchestra.run.trial160:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:48:15.144 INFO:teuthology.orchestra.run.trial026.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:15.145 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:15.146 DEBUG:teuthology.orchestra.run.trial026:> sudo rpm -qi grub2-tools 2026-02-12T22:48:15.158 INFO:teuthology.orchestra.run.trial160.stdout:/sbin/grubby 2026-02-12T22:48:15.160 INFO:teuthology.orchestra.run.trial160.stdout:yes 2026-02-12T22:48:15.160 DEBUG:teuthology.orchestra.run.trial160:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:48:15.219 INFO:teuthology.orchestra.run.trial026.stdout:Name : grub2-tools 2026-02-12T22:48:15.219 INFO:teuthology.orchestra.run.trial026.stdout:Epoch : 1 2026-02-12T22:48:15.219 INFO:teuthology.orchestra.run.trial026.stdout:Version : 2.12 2026-02-12T22:48:15.219 INFO:teuthology.orchestra.run.trial026.stdout:Release : 29.el10_1 2026-02-12T22:48:15.219 INFO:teuthology.orchestra.run.trial026.stdout:Architecture: x86_64 2026-02-12T22:48:15.219 INFO:teuthology.orchestra.run.trial026.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:48:15.219 INFO:teuthology.orchestra.run.trial026.stdout:Group : Unspecified 2026-02-12T22:48:15.220 INFO:teuthology.orchestra.run.trial026.stdout:Size : 7963769 2026-02-12T22:48:15.220 INFO:teuthology.orchestra.run.trial026.stdout:License : GPL-3.0-or-later 2026-02-12T22:48:15.220 INFO:teuthology.orchestra.run.trial026.stdout:Signature : 2026-02-12T22:48:15.220 INFO:teuthology.orchestra.run.trial026.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:48:15.220 INFO:teuthology.orchestra.run.trial026.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:48:15.220 INFO:teuthology.orchestra.run.trial026.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:48:15.220 INFO:teuthology.orchestra.run.trial026.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:48:15.220 INFO:teuthology.orchestra.run.trial026.stdout:Packager : Release Engineering 2026-02-12T22:48:15.220 INFO:teuthology.orchestra.run.trial026.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:48:15.220 INFO:teuthology.orchestra.run.trial026.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:48:15.220 INFO:teuthology.orchestra.run.trial026.stdout:Summary : Support tools for GRUB. 2026-02-12T22:48:15.220 INFO:teuthology.orchestra.run.trial026.stdout:Description : 2026-02-12T22:48:15.220 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-12T22:48:15.221 INFO:teuthology.orchestra.run.trial026.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:48:15.221 INFO:teuthology.orchestra.run.trial026.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:48:15.221 INFO:teuthology.orchestra.run.trial026.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:48:15.221 INFO:teuthology.orchestra.run.trial026.stdout:hardware devices. 2026-02-12T22:48:15.221 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-12T22:48:15.221 INFO:teuthology.orchestra.run.trial026.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:48:15.222 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:48:15.222 INFO:teuthology.task.kernel:Updating grub on trial026 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:15.222 DEBUG:teuthology.orchestra.run.trial026:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:48:15.225 INFO:teuthology.orchestra.run.trial160.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:48:15.226 DEBUG:teuthology.orchestra.run.trial160:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:15.288 INFO:teuthology.orchestra.run.trial026.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:48:15.289 DEBUG:teuthology.orchestra.run.trial026:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:48:15.302 DEBUG:teuthology.orchestra.run.trial160:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:48:15.355 INFO:teuthology.orchestra.run.trial026.stdout:/sbin/grubby 2026-02-12T22:48:15.356 INFO:teuthology.orchestra.run.trial026.stdout:yes 2026-02-12T22:48:15.357 DEBUG:teuthology.orchestra.run.trial026:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:48:15.414 INFO:teuthology.orchestra.run.trial160.stderr:Generating grub configuration file ... 2026-02-12T22:48:15.423 INFO:teuthology.orchestra.run.trial026.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:48:15.424 DEBUG:teuthology.orchestra.run.trial026:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:15.501 DEBUG:teuthology.orchestra.run.trial026:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:48:15.590 INFO:teuthology.orchestra.run.trial160.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:48:15.600 INFO:teuthology.orchestra.run.trial160.stderr:done 2026-02-12T22:48:15.601 DEBUG:teuthology.orchestra.run.trial160:> test -d /sys/firmware/efi 2026-02-12T22:48:15.611 INFO:teuthology.orchestra.run.trial026.stderr:Generating grub configuration file ... 2026-02-12T22:48:15.619 DEBUG:teuthology.orchestra.run.trial160:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:48:15.689 INFO:teuthology.orchestra.run.trial160.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:48:15.689 INFO:teuthology.orchestra.run.trial160.stdout:/boot/efi/EFI/rocky 2026-02-12T22:48:15.691 DEBUG:teuthology.orchestra.run.trial160:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:48:15.759 INFO:teuthology.orchestra.run.trial160.stdout:no 2026-02-12T22:48:15.759 DEBUG:teuthology.orchestra.run.trial160:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:48:15.789 INFO:teuthology.orchestra.run.trial026.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:48:15.798 INFO:teuthology.orchestra.run.trial026.stderr:done 2026-02-12T22:48:15.800 DEBUG:teuthology.orchestra.run.trial026:> test -d /sys/firmware/efi 2026-02-12T22:48:15.817 DEBUG:teuthology.orchestra.run.trial026:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:48:15.827 INFO:teuthology.orchestra.run.trial160.stdout:yes 2026-02-12T22:48:15.827 DEBUG:teuthology.orchestra.run.trial160:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:48:15.888 INFO:teuthology.orchestra.run.trial026.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:48:15.888 INFO:teuthology.orchestra.run.trial026.stdout:/boot/efi/EFI/rocky 2026-02-12T22:48:15.889 DEBUG:teuthology.orchestra.run.trial026:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:48:15.892 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial160 2026-02-12T22:48:15.892 DEBUG:teuthology.orchestra.run.trial160:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:48:15.956 INFO:teuthology.orchestra.run.trial026.stdout:no 2026-02-12T22:48:15.957 DEBUG:teuthology.orchestra.run.trial026:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:48:15.957 INFO:teuthology.orchestra.run.trial160.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:48:16.024 INFO:teuthology.orchestra.run.trial026.stdout:yes 2026-02-12T22:48:16.024 DEBUG:teuthology.orchestra.run.trial026:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:48:16.090 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial026 2026-02-12T22:48:16.090 DEBUG:teuthology.orchestra.run.trial026:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:48:16.155 INFO:teuthology.orchestra.run.trial026.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:48:45.935 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:45.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:45.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:46.043 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:48:46.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:46.118 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:46.118 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:48:46.133 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:46.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:46.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:46.226 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:48:46.235 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:46.235 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:46.235 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:46.235 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:46.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:46.306 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:46.306 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:48:46.363 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:46.363 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:46.364 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:46.364 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:47.236 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:47.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:47.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:47.345 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:48:47.365 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:47.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:47.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:47.431 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:48:47.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:47.441 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:47.441 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:48:47.497 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:47.498 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:47.498 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:47.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:47.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:47.506 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:47.506 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:48:47.563 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:47.563 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:47.564 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:47.564 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:48.499 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:48.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:48.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:48.596 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:48.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:48.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:48.647 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:48:48.655 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:48:48.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:48.704 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:48.704 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:48:48.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:48.729 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:48.729 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:48:48.760 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:48.761 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:48.761 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:48.761 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:48.786 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:48.787 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:48.787 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:48.787 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:49.762 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:49.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:49.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:49.860 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:49.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:49.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:49.913 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:48:49.922 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:48:49.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:49.931 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:49.931 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:48:49.987 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:49.987 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:49.987 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:49.987 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:50.011 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:50.011 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:50.011 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:48:50.068 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:50.068 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:50.068 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:50.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:50.988 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:50.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:50.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:51.086 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:51.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:51.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:51.138 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:48:51.147 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:48:51.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:51.156 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:51.156 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:48:51.213 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:51.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:51.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:51.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:51.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:51.224 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:51.224 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:48:51.281 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:51.281 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:51.282 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:51.282 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:52.214 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:52.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:52.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:52.313 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:52.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:52.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:52.365 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:48:52.374 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:48:52.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:52.383 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:52.383 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:48:52.440 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:52.440 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:52.440 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:52.440 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:52.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:52.458 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:52.458 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:48:52.515 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:52.515 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:52.515 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:52.516 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:53.441 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:53.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:53.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:53.540 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:53.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:53.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:53.593 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:48:53.601 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:48:53.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:53.611 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:53.611 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:48:53.667 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:53.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:53.671 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:53.671 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:53.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:53.692 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:53.692 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:48:53.749 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:53.750 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:53.750 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:53.750 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:54.671 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:54.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:54.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:54.769 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:54.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:54.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:54.821 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:48:54.829 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:48:54.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:54.838 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:54.838 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:48:54.896 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:54.896 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:54.896 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:54.896 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:54.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:54.904 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:54.904 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:48:54.962 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:54.963 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:54.963 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:54.963 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:55.897 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:55.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:55.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:55.996 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:55.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:55.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:56.049 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:48:56.057 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:48:56.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:56.066 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:56.066 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:48:56.122 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:56.122 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:56.122 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:56.122 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:56.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:56.138 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:56.138 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:48:56.195 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:56.195 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:56.195 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:56.195 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:57.124 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:57.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:57.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:57.223 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:57.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:57.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:57.275 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:48:57.284 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:48:57.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:57.333 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:57.333 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:48:57.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:57.356 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:57.356 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:48:57.390 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:57.390 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:57.390 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:57.390 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:57.412 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:57.412 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:57.412 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:57.412 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:58.391 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:58.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:58.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:58.490 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:58.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:58.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:58.543 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:48:58.551 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:48:58.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:58.560 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:58.561 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:48:58.617 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:58.617 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:58.617 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:58.617 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:58.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:58.627 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:58.627 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:48:58.684 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:58.684 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:58.684 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:58.684 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:59.618 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:59.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:59.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:59.689 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:59.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:59.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:59.741 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:48:59.750 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:48:59.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:48:59.758 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:59.758 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:48:59.814 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:59.814 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:59.814 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:59.814 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:59.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:48:59.824 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:59.824 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:48:59.881 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:59.881 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:59.882 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:59.882 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:00.815 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:00.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:00.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:00.915 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:00.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:00.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:00.967 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:00.976 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:00.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:00.984 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:00.984 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:01.041 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:01.042 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:01.042 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:01.042 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:01.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:01.056 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:01.056 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:01.113 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:01.113 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:01.113 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:01.113 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:02.043 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:02.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:02.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:02.141 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:02.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:02.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:02.193 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:02.201 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:02.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:02.210 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:02.211 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:02.267 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:02.268 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:02.268 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:02.268 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:02.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:02.284 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:02.284 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:02.341 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:02.341 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:02.341 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:02.341 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:03.268 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:03.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:03.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:03.353 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:03.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:03.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:03.405 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:03.413 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:03.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:03.422 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:03.422 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:03.480 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:03.480 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:03.480 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:03.480 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:03.498 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:03.498 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:03.498 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:03.557 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:03.557 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:03.557 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:03.557 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:04.481 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:04.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:04.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:04.582 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:04.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:04.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:04.635 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:04.643 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:04.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:04.652 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:04.652 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:04.709 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:04.709 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:04.709 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:04.709 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:04.725 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:04.726 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:04.726 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:04.783 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:04.783 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:04.783 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:04.783 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:05.710 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:05.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:05.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:05.812 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:05.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:05.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:05.865 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:05.874 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:05.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:05.883 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:05.883 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:05.939 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:05.939 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:05.939 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:05.939 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:05.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:05.946 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:05.946 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:06.004 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:06.004 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:06.004 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:06.004 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:06.940 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:06.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:06.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:07.005 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:07.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:07.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:07.006 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:07.075 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:07.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:07.091 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:07.091 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:07.148 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:07.148 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.148 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:07.148 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:07.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:07.149 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:07.149 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:07.206 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:07.206 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.206 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:07.207 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:08.149 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:08.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:08.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:08.250 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:08.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:08.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:08.303 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:08.312 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:08.320 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:08.320 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:08.320 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:08.376 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:08.377 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.377 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:08.377 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:08.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:08.392 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:08.392 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:08.449 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:08.449 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.449 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:08.449 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:09.377 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:09.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:09.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:09.475 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:09.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:09.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:09.528 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:09.536 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:09.545 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:09.545 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:09.545 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:09.601 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:09.602 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:09.602 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:09.602 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:09.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:09.608 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:09.608 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:09.666 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:09.666 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:09.667 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:09.667 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:10.603 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:10.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:10.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:10.702 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:10.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:10.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:10.755 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:10.779 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:10.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:10.779 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:10.779 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:10.835 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:10.836 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:10.836 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:10.836 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:10.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:10.836 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:10.836 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:10.894 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:10.894 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:10.894 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:10.894 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:11.836 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:11.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:11.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:11.937 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:11.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:11.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:11.989 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:11.998 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:12.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:12.006 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:12.006 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:12.063 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:12.063 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:12.063 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:12.063 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:12.075 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:12.075 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:12.075 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:12.132 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:12.133 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:12.133 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:12.133 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:13.064 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:13.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:13.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:13.163 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:13.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:13.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:13.216 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:13.224 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:13.233 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:13.233 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:13.233 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:13.290 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:13.291 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:13.291 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:13.291 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:13.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:13.311 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:13.311 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:13.368 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:13.369 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:13.369 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:13.369 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:14.292 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:14.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:14.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:14.390 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:14.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:14.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:14.442 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:14.451 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:14.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:14.460 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:14.460 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:14.517 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:14.517 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:14.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:14.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:14.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:14.538 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:14.538 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:14.596 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:14.596 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:14.596 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:14.596 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:15.519 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:15.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:15.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:15.619 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:15.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:15.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:15.672 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:15.680 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:15.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:15.689 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:15.689 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:15.746 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:15.747 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:15.747 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:15.747 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:15.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:15.766 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:15.766 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:15.822 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:15.823 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:15.823 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:15.823 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:16.748 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:16.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:16.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:16.843 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:16.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:16.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:16.853 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:16.905 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:16.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:16.939 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:16.939 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:16.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:16.982 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:16.982 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:16.995 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:16.995 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:16.995 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:16.995 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:17.039 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:17.039 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:17.039 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:17.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:17.996 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:17.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:17.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:18.095 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:18.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:18.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:18.148 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:18.156 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:18.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:18.165 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:18.165 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:18.224 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:18.224 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:18.224 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:18.224 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:18.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:18.241 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:18.241 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:18.298 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:18.298 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:18.298 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:18.299 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:19.225 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:19.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:19.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:19.323 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:19.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:19.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:19.375 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:19.384 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:19.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:19.392 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:19.392 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:19.449 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:19.449 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:19.449 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:19.449 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:19.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:19.464 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:19.464 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:19.522 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:19.522 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:19.522 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:19.523 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:20.450 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:20.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:20.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:20.551 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:20.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:20.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:20.603 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:20.612 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:20.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:20.620 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:20.620 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:20.677 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:20.677 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:20.677 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:20.677 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:20.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:20.690 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:20.690 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:20.748 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:20.748 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:20.749 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:20.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:21.678 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:21.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:21.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:21.777 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:21.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:21.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:21.829 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:21.837 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:21.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:21.847 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:21.847 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:21.905 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:21.905 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:21.905 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:21.905 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:21.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:21.911 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:21.911 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:21.968 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:21.969 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:21.969 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:21.969 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:22.907 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:22.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:22.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:22.970 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:22.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:22.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:22.976 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:23.030 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:23.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:23.054 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:23.054 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:23.111 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:23.111 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:23.112 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:23.112 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:23.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:23.113 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:23.113 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:23.170 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:23.170 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:23.170 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:23.170 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:24.112 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:24.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:24.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:24.212 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:24.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:24.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:24.264 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:24.272 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:24.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:24.321 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:24.321 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:24.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:24.352 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:24.352 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:24.378 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:24.378 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:24.378 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:24.378 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:24.410 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:24.410 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:24.410 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:24.410 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:25.379 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:25.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:25.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:25.479 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:25.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:25.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:25.530 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:25.539 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:25.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:25.548 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:25.548 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:25.605 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:25.605 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:25.605 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:25.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:25.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:25.612 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:25.612 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:25.669 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:25.669 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:25.669 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:25.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:26.606 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:26.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:26.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:26.706 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:26.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:26.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:26.757 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:26.766 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:26.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:26.815 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:26.815 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:26.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:26.841 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:26.841 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:26.872 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:26.872 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:26.872 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:26.872 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:26.898 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:26.899 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:26.899 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:26.899 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:27.873 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:27.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:27.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:27.972 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:27.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:27.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:28.025 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:28.033 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:28.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:28.042 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:28.042 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:28.100 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:28.100 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:28.100 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:28.100 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:28.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:28.106 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:28.107 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:28.164 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:28.164 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:28.164 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:28.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:29.101 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:29.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:29.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:29.197 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:29.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:29.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:29.249 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:29.258 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:29.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:29.266 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:29.266 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:29.323 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:29.323 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:29.323 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:29.323 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:29.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:29.330 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:29.330 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:29.388 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:29.388 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:29.389 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:29.389 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:30.324 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:30.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:30.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:30.423 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:30.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:30.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:30.476 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:30.484 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:30.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:30.493 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:30.493 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:30.550 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:30.550 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:30.550 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:30.550 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:30.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:30.565 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:30.565 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:30.622 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:30.622 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:30.622 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:30.622 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:31.551 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:31.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:31.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:31.650 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:31.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:31.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:31.703 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:31.711 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:31.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:31.720 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:31.720 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:31.776 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:31.777 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:31.777 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:31.777 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:31.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:31.792 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:31.792 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:31.849 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:31.849 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:31.849 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:31.849 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:32.777 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:32.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:32.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:32.874 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:32.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:32.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:32.926 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:32.935 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:32.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:32.943 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:32.943 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:33.000 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:33.000 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:33.000 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:33.001 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:33.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:33.019 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:33.019 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:33.077 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:33.077 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:33.077 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:33.077 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:34.002 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:34.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:34.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:34.102 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:34.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:34.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:34.155 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:34.163 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:34.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:34.172 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:34.172 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:34.229 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:34.229 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:34.229 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:34.229 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:34.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:34.241 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:34.241 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:34.298 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:34.298 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:34.299 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:34.299 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:35.230 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:35.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:35.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:35.328 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:35.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:35.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:35.381 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:35.389 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:35.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:35.398 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:35.398 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:35.456 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:35.456 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:35.456 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:35.456 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:35.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:35.478 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:35.479 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:35.536 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:35.536 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:35.536 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:35.536 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:36.457 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:36.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:36.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:36.558 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:36.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:36.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:36.611 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:36.619 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:36.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:36.628 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:36.628 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:36.685 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:36.685 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:36.685 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:36.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:36.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:36.697 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:36.697 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:36.754 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:36.754 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:36.754 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:36.754 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:37.686 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:37.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:37.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:37.747 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:37.756 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:37.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:37.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:37.820 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:37.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:37.829 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:37.829 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:37.886 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:37.886 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:37.886 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:37.887 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:37.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:37.899 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:37.899 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:37.956 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:37.956 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:37.956 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:37.956 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:38.887 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:38.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:38.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:38.958 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:38.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:38.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:38.962 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:39.018 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:39.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:39.046 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:39.046 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:39.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:39.101 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:39.101 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:39.103 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:39.103 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:39.103 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:39.104 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:39.159 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:39.159 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:39.159 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:39.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:40.105 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:40.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:40.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:40.166 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:40.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:40.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:40.218 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:40.226 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:40.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:40.236 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:40.236 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:40.292 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:40.292 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:40.292 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:40.292 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:40.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:40.316 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:40.316 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:40.373 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:40.373 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:40.373 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:40.373 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:41.292 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:41.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:41.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:41.408 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:41.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:41.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:41.418 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:41.469 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:41.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:41.501 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:41.501 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:41.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:41.549 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:41.550 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:41.558 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:41.558 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:41.558 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:41.558 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:41.607 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:41.607 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:41.607 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:41.608 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:42.560 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:42.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:42.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:42.658 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:42.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:42.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:42.710 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:42.719 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:42.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:42.727 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:42.727 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:42.784 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:42.784 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:42.784 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:42.784 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:42.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:42.797 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:42.797 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:42.854 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:42.854 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:42.854 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:42.854 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:43.785 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:43.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:43.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:43.883 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:43.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:43.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:43.935 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:43.944 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:43.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:43.952 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:43.953 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:44.009 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:44.009 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:44.009 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:44.009 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:44.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:44.016 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:44.017 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:44.074 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:44.074 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:44.074 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:44.074 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:45.010 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:45.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:45.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:45.110 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:45.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:45.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:45.162 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:45.170 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:45.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:45.181 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:45.181 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:45.237 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:45.237 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:45.237 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:45.237 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:45.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:45.257 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:45.257 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:45.314 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:45.314 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:45.314 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:45.314 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:46.238 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:46.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:46.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:46.337 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:46.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:46.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:46.389 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:46.398 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:46.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:46.407 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:46.407 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:46.463 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:46.464 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:46.464 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:46.464 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:46.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:46.483 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:46.483 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:46.540 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:46.540 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:46.540 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:46.540 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:47.465 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:47.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:47.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:47.564 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:47.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:47.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:47.617 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:47.625 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:47.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:47.634 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:47.634 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:47.691 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:47.692 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:47.692 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:47.692 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:47.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:47.709 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:47.709 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:47.766 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:47.767 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:47.767 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:47.767 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:48.693 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:48.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:48.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:48.753 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:48.768 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:48.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:48.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:48.828 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:48.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:48.835 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:48.835 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:48.892 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:48.892 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:48.892 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:48.892 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:48.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:48.912 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:48.912 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:48.969 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:48.969 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:48.969 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:48.969 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:49.892 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:49.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:49.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:49.991 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:49.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:49.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:50.042 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:50.051 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:50.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:50.060 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:50.060 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:50.117 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:50.117 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:50.117 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:50.117 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:50.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:50.131 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:50.131 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:50.189 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:50.189 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:50.189 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:50.189 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:51.118 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:51.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:51.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:51.241 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:51.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:51.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:51.251 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:51.301 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:51.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:51.339 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:51.339 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:51.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:51.384 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:51.384 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:51.396 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:51.397 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:51.397 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:51.397 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:51.441 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:51.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:51.442 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:51.442 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:52.398 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:52.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:52.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:52.451 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:52.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:52.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:52.503 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:52.511 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:52.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:52.562 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:52.562 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:52.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:52.588 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:52.588 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:52.618 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:52.618 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:52.618 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:52.618 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:52.644 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:52.644 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:52.645 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:52.645 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:53.619 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:53.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:53.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:53.689 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:53.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:53.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:53.741 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:53.750 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:53.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:53.759 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:53.759 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:53.816 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:53.816 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:53.816 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:53.816 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:53.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:53.832 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:53.832 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:53.889 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:53.889 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:53.889 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:53.889 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:54.817 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:54.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:54.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:54.915 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:54.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:54.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:54.968 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:54.977 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:54.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:54.986 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:54.986 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:55.042 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:55.043 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:55.043 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:55.043 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:55.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:55.066 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:55.067 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:55.123 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:55.123 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:55.123 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:55.123 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:56.043 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:56.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:56.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:56.142 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:56.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:56.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:56.194 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:56.203 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:56.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:56.212 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:56.212 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:56.268 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:56.268 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:56.268 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:56.268 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:56.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:56.277 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:56.277 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:56.333 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:56.334 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:56.334 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:56.334 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:57.269 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:57.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:57.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:57.369 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:57.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:57.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:57.422 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:57.430 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:57.439 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:57.439 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:57.439 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:57.497 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:57.497 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:57.497 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:57.497 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:57.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:57.506 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:57.506 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:57.563 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:57.563 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:57.563 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:57.563 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:58.498 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:58.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:58.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:58.599 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:58.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:58.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:58.660 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:58.668 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:58.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:58.678 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:58.678 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:58.734 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:58.734 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:58.734 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:58.734 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:58.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:58.749 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:58.749 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:49:58.806 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:58.806 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:58.806 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:58.806 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:59.736 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:59.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:59.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:59.837 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:59.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:59.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:59.890 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:49:59.898 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:49:59.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:49:59.907 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:59.907 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:49:59.965 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:59.965 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:59.965 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:59.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:59.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:49:59.976 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:59.976 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:00.033 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:00.033 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:00.033 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:00.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:00.966 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:00.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:00.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:01.065 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:01.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:01.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:01.118 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:01.127 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:01.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:01.136 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:01.136 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:01.192 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:01.192 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:01.192 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:01.192 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:01.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:01.201 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:01.201 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:01.259 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:01.259 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:01.259 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:01.259 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:02.193 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:02.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:02.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:02.292 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:02.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:02.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:02.345 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:02.353 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:02.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:02.363 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:02.363 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:02.419 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:02.420 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:02.420 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:02.420 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:02.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:02.438 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:02.438 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:02.495 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:02.495 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:02.495 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:02.495 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:03.421 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:03.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:03.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:03.519 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:03.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:03.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:03.571 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:03.580 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:03.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:03.589 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:03.589 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:03.647 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:03.647 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:03.647 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:03.647 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:03.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:03.666 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:03.666 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:03.723 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:03.723 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:03.723 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:03.723 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:04.648 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:04.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:04.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:04.747 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:04.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:04.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:04.800 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:04.809 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:04.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:04.818 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:04.818 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:04.875 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:04.875 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:04.875 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:04.875 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:04.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:04.900 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:04.900 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:04.956 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:04.956 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:04.956 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:04.956 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:05.876 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:05.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:05.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:05.974 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:05.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:05.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:06.027 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:06.035 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:06.044 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:06.044 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:06.044 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:06.100 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:06.100 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:06.100 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:06.100 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:06.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:06.113 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:06.113 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:06.170 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:06.170 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:06.170 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:06.171 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:07.101 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:07.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:07.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:07.200 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:07.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:07.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:07.252 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:07.260 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:07.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:07.269 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:07.269 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:07.325 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:07.325 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:07.326 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:07.326 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:07.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:07.341 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:07.341 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:07.398 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:07.399 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:07.399 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:07.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:08.326 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:08.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:08.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:08.424 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:08.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:08.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:08.476 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:08.485 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:08.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:08.493 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:08.493 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:08.551 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:08.551 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:08.551 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:08.551 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:08.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:08.564 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:08.564 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:08.621 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:08.622 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:08.622 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:08.622 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:09.552 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:09.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:09.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:09.651 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:09.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:09.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:09.703 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:09.712 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:09.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:09.761 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:09.761 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:09.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:09.800 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:09.800 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:09.819 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:09.819 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:09.819 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:09.819 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:09.857 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:09.857 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:09.857 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:09.857 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:10.821 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:10.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:10.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:10.922 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:10.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:10.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:10.975 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:10.983 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:10.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:10.993 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:10.993 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:11.049 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:11.050 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:11.050 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:11.050 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:11.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:11.059 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:11.059 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:11.117 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:11.118 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:11.118 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:11.118 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:12.051 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:12.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:12.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:12.125 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:12.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:12.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:12.177 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:12.185 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:12.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:12.194 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:12.194 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:12.253 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:12.253 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:12.253 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:12.253 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:12.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:12.273 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:12.273 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:12.331 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:12.332 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:12.332 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:12.332 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:13.254 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:13.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:13.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:13.327 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:13.333 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:13.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:13.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:13.400 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:13.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:13.416 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:13.416 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:13.473 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:13.473 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:13.473 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:13.473 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:13.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:13.482 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:13.482 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:13.539 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:13.539 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:13.540 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:13.540 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:14.474 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:14.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:14.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:14.552 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:14.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:14.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:14.604 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:14.612 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:14.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:14.622 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:14.622 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:14.679 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:14.679 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:14.679 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:14.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:14.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:14.693 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:14.693 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:14.751 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:14.751 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:14.751 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:14.751 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:15.681 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:15.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:15.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:15.751 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:15.752 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:15.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:15.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:15.811 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:15.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:15.823 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:15.823 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:15.880 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:15.880 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:15.880 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:15.880 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:15.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:15.903 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:15.904 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:15.960 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:15.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:15.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:15.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:16.881 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:16.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:16.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:16.979 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:16.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:16.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:17.030 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:17.039 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:17.088 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:17.088 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:17.089 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:17.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:17.124 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:17.125 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:17.145 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:17.145 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:17.145 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:17.145 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:17.181 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:17.181 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:17.181 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:17.181 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:18.146 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:18.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:18.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:18.245 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:18.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:18.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:18.297 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:18.305 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:18.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:18.314 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:18.314 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:18.372 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:18.373 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:18.373 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:18.373 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:18.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:18.386 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:18.386 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:18.443 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:18.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:18.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:18.444 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:19.373 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:19.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:19.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:19.472 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:19.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:19.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:19.525 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:19.533 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:19.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:19.543 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:19.543 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:19.599 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:19.600 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:19.600 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:19.600 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:19.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:19.613 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:19.613 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:19.670 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:19.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:19.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:19.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:20.601 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:20.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:20.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:20.700 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:20.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:20.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:20.752 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:20.761 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:20.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:20.770 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:20.770 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:20.826 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:20.827 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:20.827 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:20.827 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:20.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:20.834 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:20.834 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:20.892 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:20.892 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:20.892 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:20.892 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:21.828 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:21.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:21.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:21.896 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:21.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:21.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:21.948 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:21.957 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:22.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:22.006 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:22.007 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:22.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:22.031 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:22.031 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:22.063 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:22.063 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:22.063 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:22.063 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:22.089 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:22.089 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:22.089 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:22.089 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:23.064 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:23.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:23.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:23.176 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:23.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:23.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:23.227 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:23.236 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:23.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:23.245 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:23.245 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:23.302 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:23.302 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:23.302 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:23.302 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:23.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:23.316 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:23.316 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:23.373 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:23.373 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:23.373 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:23.373 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:24.303 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:24.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:24.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:24.401 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:24.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:24.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:24.454 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:24.462 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:24.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:24.471 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:24.471 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:24.527 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:24.527 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:24.527 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:24.528 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:24.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:24.547 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:24.547 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:24.605 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:24.605 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:24.605 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:24.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:25.528 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:25.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:25.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:25.627 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:25.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:25.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:25.679 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:25.688 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:25.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:25.697 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:25.697 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:25.754 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:25.754 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:25.754 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:25.754 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:25.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:25.770 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:25.770 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:25.828 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:25.829 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:25.829 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:25.830 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:26.755 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:26.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:26.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:26.852 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:26.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:26.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:26.905 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:26.913 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:26.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:26.923 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:26.923 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:26.979 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:26.979 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:26.979 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:26.979 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:26.987 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:26.987 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:26.987 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:27.044 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:27.044 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.044 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:27.044 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:27.980 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:27.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:27.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:28.079 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:28.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:28.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:28.131 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:28.140 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:28.148 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:28.148 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:28.148 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:28.205 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:28.206 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:28.206 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:28.206 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:28.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:28.219 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:28.219 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:28.276 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:28.276 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:28.276 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:28.276 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:29.207 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:29.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:29.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:29.305 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:29.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:29.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:29.357 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:29.366 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:29.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:29.374 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:29.374 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:29.431 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:29.431 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:29.432 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:29.432 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:29.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:29.449 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:29.449 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:29.506 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:29.506 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:29.506 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:29.506 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:30.433 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:30.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:30.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:30.531 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:30.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:30.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:30.584 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:30.592 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:30.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:30.601 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:30.601 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:30.659 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:30.659 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:30.659 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:30.659 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:30.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:30.670 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:30.670 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:30.727 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:30.727 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:30.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:30.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:31.659 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:31.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:31.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:31.728 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:31.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:31.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:31.736 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:31.788 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:31.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:31.825 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:31.825 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:31.861 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:31.861 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:31.861 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:31.882 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:31.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:31.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:31.883 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:31.918 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:31.918 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:31.918 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:31.918 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:32.884 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:32.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:32.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:32.939 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:32.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:32.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:32.991 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:32.999 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:33.008 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:33.008 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:33.008 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:33.065 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:33.065 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:33.065 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:33.065 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:33.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:33.087 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:33.087 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:33.144 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:33.144 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:33.145 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:33.145 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:34.066 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:34.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:34.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:34.161 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:34.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:34.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:34.213 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:34.222 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:34.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:34.231 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:34.231 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:34.289 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:34.289 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:34.289 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:34.289 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:34.310 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:34.310 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:34.310 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:34.367 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:34.367 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:34.367 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:34.367 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:35.290 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:35.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:35.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:35.371 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:35.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:35.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:35.436 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:35.444 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:35.453 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:35.453 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:35.454 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:35.511 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:35.511 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:35.511 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:35.511 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:35.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:35.534 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:35.534 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:35.590 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:35.591 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:35.591 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:35.591 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:36.512 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:36.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:36.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:36.610 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:36.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:36.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:36.663 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:36.671 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:36.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:36.680 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:36.680 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:36.738 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:36.738 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:36.738 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:36.738 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:36.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:36.746 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:36.747 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:36.804 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:36.804 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:36.805 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:36.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:37.739 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:37.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:37.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:37.837 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:37.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:37.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:37.889 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:37.897 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:37.906 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:37.906 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:37.906 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:37.963 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:37.963 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:37.964 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:37.964 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:37.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:37.974 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:37.974 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:38.032 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:38.032 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:38.032 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:38.032 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:38.964 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:38.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:38.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:39.062 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:39.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:39.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:39.114 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:39.122 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:39.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:39.132 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:39.132 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:39.189 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:39.190 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:39.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:39.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:39.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:39.201 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:39.201 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:39.258 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:39.258 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:39.258 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:39.258 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:40.191 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:40.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:40.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:40.290 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:40.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:40.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:40.342 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:40.350 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:40.360 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:40.360 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:40.360 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:40.417 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:40.417 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:40.417 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:40.417 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:40.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:40.433 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:40.433 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:40.490 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:40.490 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:40.490 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:40.491 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:41.418 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:41.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:41.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:41.492 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:41.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:41.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:41.494 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:41.552 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:41.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:41.573 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:41.573 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:41.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:41.626 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:41.627 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:41.630 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:41.630 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:41.630 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:41.630 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:41.684 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:41.685 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:41.685 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:41.685 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:42.632 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:42.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:42.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:42.740 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:42.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:42.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:42.791 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:42.800 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:42.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:42.808 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:42.809 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:42.865 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:42.865 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:42.865 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:42.865 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:42.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:42.884 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:42.884 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:42.940 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:42.941 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:42.941 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:42.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:43.866 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:43.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:43.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:43.964 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:43.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:43.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:44.016 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:44.025 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:44.033 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:44.033 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:44.033 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:44.090 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:44.090 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:44.090 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:44.090 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:44.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:44.104 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:44.104 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:44.160 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:44.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:44.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:44.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:45.092 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:45.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:45.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:45.216 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:45.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:45.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:45.227 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:45.278 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:45.303 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:45.303 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:45.303 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:45.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:45.358 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:45.358 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:45.359 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:45.360 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:45.360 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:45.360 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:45.416 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:45.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:45.417 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:45.417 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:46.361 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:46.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:46.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:46.486 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:46.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:46.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:46.497 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:46.549 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:46.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:46.573 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:46.574 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:46.630 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:46.630 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:46.630 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:46.630 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:46.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:46.632 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:46.632 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:46.689 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:46.689 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:46.689 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:46.689 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:47.631 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:47.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:47.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:47.759 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:47.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:47.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:47.770 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:47.821 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:47.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:47.847 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:47.847 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:47.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:47.896 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:47.896 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:47.904 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:47.904 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:47.904 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:47.904 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:47.953 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:47.954 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:47.954 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:47.954 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:48.906 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:48.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:48.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:49.029 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:49.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:49.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:49.039 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:49.090 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:49.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:49.112 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:49.112 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:49.169 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:49.169 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:49.169 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:49.169 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:49.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:49.170 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:49.170 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:49.227 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:49.227 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:49.227 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:49.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:50.170 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:50.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:50.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:50.269 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:50.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:50.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:50.321 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:50.329 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:50.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:50.338 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:50.338 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:50.395 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:50.395 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:50.395 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:50.395 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:50.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:50.402 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:50.402 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:50.459 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:50.460 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:50.460 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:50.460 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:51.396 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:51.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:51.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:51.495 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:51.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:51.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:51.548 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:51.556 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:51.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:51.565 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:51.565 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:51.622 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:51.622 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:51.622 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:51.622 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:51.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:51.627 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:51.627 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:51.685 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:51.685 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:51.685 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:51.685 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:52.624 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:52.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:52.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:52.722 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:52.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:52.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:52.775 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:52.783 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:52.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:52.792 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:52.792 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:52.848 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:52.848 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:52.848 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:52.848 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:52.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:52.860 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:52.860 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:52.918 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:52.918 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:52.918 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:52.918 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:53.849 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:53.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:53.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:53.947 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:53.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:53.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:53.999 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:54.008 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:54.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:54.017 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:54.017 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:54.073 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:54.074 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:54.074 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:54.074 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:54.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:54.097 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:54.097 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:54.154 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:54.154 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:54.155 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:54.155 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:55.074 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:55.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:55.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:55.173 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:55.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:55.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:55.225 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:55.233 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:55.242 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:55.242 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:55.242 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:55.298 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:55.298 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:55.298 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:55.299 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:55.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:55.318 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:55.319 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:55.376 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:55.377 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:55.377 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:55.377 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:56.300 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:56.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:56.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:56.399 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:56.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:56.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:56.450 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:56.459 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:56.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:56.508 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:56.508 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:56.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:56.535 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:56.535 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:56.564 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:56.564 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:56.564 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:56.564 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:56.592 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:56.592 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:56.592 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:56.592 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:57.565 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:57.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:57.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:57.670 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:57.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:57.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:57.745 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:57.755 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:57.765 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:57.765 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:57.765 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:57.822 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:57.822 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:57.822 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:57.822 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:57.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:57.829 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:57.829 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:57.885 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:57.886 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:57.886 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:57.886 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:58.823 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:58.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:58.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:58.923 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:58.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:58.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:58.976 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:50:58.984 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:50:58.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:50:58.994 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:58.994 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:50:59.052 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:59.052 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:59.052 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:59.052 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:59.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:50:59.073 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:59.073 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:50:59.130 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:59.130 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:59.130 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:59.131 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:00.053 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:00.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:00.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:00.152 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:00.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:00.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:00.205 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:00.213 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:00.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:00.223 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:00.223 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:00.282 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:00.282 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:00.282 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:00.282 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:00.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:00.305 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:00.305 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:00.362 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:00.362 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:00.363 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:00.363 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:01.283 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:01.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:01.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:01.380 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:01.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:01.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:01.431 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:01.440 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:01.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:01.449 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:01.449 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:01.507 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:01.507 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:01.507 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:01.507 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:01.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:01.512 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:01.512 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:01.569 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:01.569 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:01.570 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:01.570 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:02.508 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:02.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:02.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:02.607 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:02.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:02.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:02.660 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:02.668 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:02.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:02.677 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:02.677 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:02.734 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:02.734 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:02.735 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:02.735 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:02.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:02.747 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:02.747 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:02.804 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:02.804 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:02.805 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:02.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:03.736 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:03.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:03.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:03.834 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:03.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:03.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:03.887 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:03.896 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:03.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:03.905 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:03.905 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:03.961 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:03.962 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:03.962 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:03.962 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:03.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:03.986 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:03.986 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:04.044 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:04.044 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:04.044 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:04.044 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:04.963 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:04.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:04.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:05.061 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:05.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:05.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:05.113 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:05.121 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:05.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:05.130 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:05.130 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:05.186 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:05.186 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:05.186 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:05.186 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:05.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:05.193 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:05.193 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:05.250 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:05.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:05.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:05.250 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:06.188 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:06.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:06.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:06.286 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:06.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:06.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:06.339 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:06.347 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:06.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:06.356 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:06.356 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:06.414 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:06.414 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:06.414 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:06.414 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:06.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:06.432 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:06.432 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:06.490 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:06.490 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:06.490 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:06.490 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:07.415 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:07.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:07.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:07.514 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:07.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:07.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:07.567 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:07.576 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:07.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:07.585 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:07.585 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:07.641 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:07.641 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:07.641 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:07.641 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:07.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:07.653 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:07.653 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:07.710 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:07.710 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:07.710 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:07.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:08.643 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:08.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:08.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:08.741 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:08.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:08.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:08.794 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:08.803 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:08.811 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:08.811 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:08.811 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:08.868 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:08.868 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:08.868 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:08.868 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:08.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:08.880 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:08.880 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:08.938 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:08.939 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:08.939 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:08.939 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:09.869 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:09.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:09.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:09.940 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:09.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:09.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:09.942 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:10.003 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:10.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:10.021 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:10.021 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:10.078 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:10.078 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:10.078 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:10.078 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:10.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:10.079 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:10.079 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:10.136 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:10.136 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:10.136 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:10.136 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:11.079 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:11.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:11.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:11.144 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:11.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:11.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:11.196 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:11.205 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:11.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:11.213 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:11.213 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:11.269 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:11.269 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:11.269 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:11.269 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:11.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:11.278 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:11.278 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:11.335 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:11.335 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:11.336 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:11.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:12.270 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:12.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:12.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:12.369 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:12.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:12.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:12.420 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:12.429 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:12.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:12.479 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:12.479 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:12.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:12.505 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:12.505 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:12.536 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:12.536 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:12.537 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:12.537 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:12.561 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:12.562 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:12.562 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:12.562 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:13.538 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:13.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:13.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:13.636 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:13.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:13.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:13.688 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:13.696 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:13.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:13.705 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:13.706 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:13.762 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:13.762 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:13.763 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:13.763 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:13.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:13.773 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:13.773 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:13.830 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:13.830 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:13.830 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:13.830 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:14.763 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:14.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:14.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:14.862 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:14.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:14.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:14.914 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:14.923 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:14.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:14.931 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:14.931 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:14.988 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:14.988 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:14.988 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:14.988 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:14.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:14.997 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:14.997 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:15.055 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:15.055 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:15.055 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:15.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:15.989 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:15.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:15.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:16.088 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:16.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:16.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:16.142 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:16.151 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:16.160 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:16.160 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:16.160 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:16.216 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:16.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:16.217 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:16.217 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:16.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:16.228 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:16.228 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:16.285 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:16.285 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:16.285 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:16.285 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:17.218 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:17.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:17.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:17.315 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:17.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:17.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:17.368 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:17.377 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:17.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:17.386 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:17.386 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:17.442 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:17.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:17.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:17.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:17.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:17.449 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:17.449 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:17.507 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:17.507 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:17.508 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:17.508 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:18.444 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:18.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:18.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:18.541 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:18.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:18.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:18.594 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:18.602 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:18.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:18.611 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:18.611 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:18.667 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:18.667 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:18.667 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:18.667 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:18.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:18.682 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:18.682 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:18.739 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:18.739 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:18.739 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:18.739 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:19.668 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:19.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:19.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:19.766 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:19.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:19.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:19.818 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:19.827 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:19.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:19.835 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:19.835 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:19.891 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:19.891 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:19.891 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:19.892 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:19.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:19.903 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:19.903 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:19.959 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:19.960 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:19.960 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:19.960 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:20.892 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:20.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:20.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:20.991 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:20.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:20.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:21.042 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:21.051 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:21.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:21.060 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:21.060 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:21.117 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:21.117 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:21.117 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:21.117 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:21.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:21.135 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:21.135 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:21.192 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:21.192 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:21.192 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:21.193 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:22.118 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:22.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:22.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:22.217 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:22.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:22.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:22.270 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:22.279 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:22.287 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:22.287 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:22.287 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:22.343 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:22.343 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:22.343 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:22.344 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:22.360 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:22.361 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:22.361 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:22.418 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:22.418 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:22.418 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:22.418 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:23.345 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:23.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:23.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:23.441 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:23.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:23.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:23.493 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:23.502 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:23.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:23.510 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:23.510 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:23.566 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:23.567 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:23.567 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:23.567 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:23.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:23.578 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:23.578 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:23.636 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:23.636 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:23.636 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:23.637 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:24.567 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:24.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:24.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:24.666 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:24.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:24.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:24.719 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:24.727 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:24.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:24.736 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:24.736 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:24.793 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:24.793 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:24.793 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:24.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:24.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:24.816 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:24.816 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:24.873 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:24.873 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:24.873 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:24.873 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:25.795 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:25.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:25.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:25.893 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:25.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:25.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:25.946 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:25.955 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:25.964 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:25.964 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:25.964 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:26.021 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:26.022 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:26.022 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:26.022 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:26.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:26.029 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:26.029 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:26.086 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:26.086 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:26.087 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:26.087 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:27.023 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:27.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:27.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:27.121 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:27.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:27.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:27.174 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:27.182 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:27.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:27.191 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:27.191 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:27.248 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:27.248 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:27.248 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:27.249 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:27.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:27.272 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:27.272 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:27.319 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:27.320 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:27.320 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:27.320 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:28.249 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:28.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:28.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:28.334 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:28.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:28.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:28.387 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:28.395 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:28.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:28.404 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:28.404 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:28.462 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:28.462 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:28.462 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:28.462 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:28.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:28.472 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:28.472 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:28.530 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:28.530 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:28.530 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:28.530 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:29.463 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:29.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:29.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:29.563 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:29.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:29.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:29.616 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:29.624 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:29.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:29.633 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:29.633 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:29.691 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:29.691 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:29.691 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:29.691 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:29.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:29.704 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:29.704 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:29.762 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:29.762 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:29.762 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:29.762 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:30.692 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:30.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:30.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:30.790 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:30.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:30.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:30.843 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:30.851 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:30.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:30.860 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:30.860 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:30.919 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:30.919 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:30.919 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:30.919 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:30.924 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:30.924 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:30.925 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:30.982 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:30.983 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:30.983 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:30.983 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:31.920 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:31.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:31.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:32.003 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:32.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:32.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:32.055 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:32.063 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:32.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:32.074 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:32.074 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:32.130 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:32.130 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:32.131 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:32.131 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:32.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:32.144 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:32.144 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:32.201 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:32.202 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:32.202 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:32.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:33.131 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:33.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:33.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:33.203 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:33.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:33.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:33.254 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:33.262 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:33.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:33.271 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:33.271 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:33.328 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:33.328 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:33.328 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:33.328 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:33.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:33.341 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:33.341 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:33.398 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:33.398 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:33.398 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:33.398 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:34.329 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:34.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:34.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:34.401 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:34.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:34.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:34.453 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:34.462 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:34.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:34.471 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:34.471 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:34.528 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:34.528 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:34.528 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:34.528 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:34.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:34.549 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:34.550 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:34.607 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:34.607 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:34.607 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:34.607 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:35.529 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:35.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:35.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:35.603 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:35.609 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:35.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:35.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:35.674 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:35.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:35.683 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:35.683 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:35.740 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:35.740 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:35.740 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:35.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:35.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:35.752 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:35.753 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:35.810 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:35.811 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:35.811 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:35.811 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:36.742 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:36.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:36.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:36.840 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:36.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:36.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:36.893 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:36.901 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:36.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:36.911 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:36.911 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:36.967 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:36.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:36.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:36.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:36.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:36.989 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:36.989 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:37.047 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:37.047 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:37.047 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:37.048 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:37.968 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:37.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:37.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:38.069 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:38.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:38.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:38.120 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:38.129 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:38.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:38.137 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:38.137 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:38.194 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:38.195 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:38.195 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:38.195 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:38.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:38.218 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:38.218 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:38.276 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:38.276 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:38.276 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:38.277 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:39.196 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:39.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:39.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:39.296 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:39.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:39.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:39.348 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:39.357 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:39.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:39.366 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:39.366 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:39.422 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:39.423 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:39.423 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:39.423 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:39.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:39.432 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:39.432 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:39.488 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:39.489 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:39.489 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:39.489 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:40.423 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:40.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:40.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:40.490 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:40.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:40.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:40.494 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:40.550 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:40.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:40.580 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:40.580 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:40.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:40.630 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:40.630 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:40.637 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:40.637 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:40.637 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:40.637 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:40.688 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:40.688 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:40.688 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:40.688 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:41.638 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:41.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:41.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:41.759 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:41.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:41.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:41.770 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:41.824 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:41.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:41.852 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:41.853 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:41.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:41.904 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:41.904 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:41.909 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:41.909 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:41.909 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:41.909 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:41.961 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:41.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:41.962 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:41.962 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:42.911 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:42.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:42.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:43.040 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:43.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:43.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:43.051 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:43.102 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:43.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:43.128 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:43.128 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:43.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:43.184 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:43.184 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:43.185 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:43.185 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:43.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:43.185 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:43.241 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:43.241 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:43.241 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:43.241 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:44.186 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:44.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:44.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:44.312 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:44.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:44.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:44.323 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:44.374 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:44.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:44.396 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:44.396 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:44.453 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:44.453 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:44.453 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:44.453 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:44.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:44.463 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:44.463 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:44.520 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:44.520 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:44.520 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:44.520 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:45.454 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:45.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:45.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:45.577 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:45.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:45.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:45.587 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:45.638 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:45.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:45.674 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:45.674 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:45.725 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:45.726 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:45.726 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:45.731 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:45.731 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:45.731 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:45.731 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:45.783 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:45.783 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:45.784 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:45.784 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:46.732 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:46.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:46.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:46.839 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:46.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:46.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:46.891 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:46.899 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:46.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:46.949 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:46.949 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:46.981 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:46.981 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:46.982 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:47.006 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:47.006 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:47.006 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:47.007 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:47.039 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:47.040 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:47.040 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:47.040 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:48.007 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:48.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:48.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:48.089 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:48.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:48.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:48.155 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:48.164 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:48.173 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:48.173 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:48.173 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:48.230 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:48.230 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:48.230 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:48.230 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:48.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:48.240 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:48.240 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:48.296 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:48.296 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:48.296 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:48.297 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:49.230 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:49.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:49.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:49.329 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:49.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:49.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:49.393 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:49.402 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:49.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:49.411 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:49.411 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:49.467 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:49.467 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:49.467 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:49.467 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:49.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:49.485 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:49.485 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:49.542 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:49.542 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:49.543 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:49.543 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:50.468 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:50.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:50.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:50.565 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:50.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:50.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:50.617 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:50.626 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:50.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:50.634 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:50.634 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:50.691 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:50.691 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:50.691 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:50.691 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:50.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:50.695 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:50.695 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:50.752 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:50.752 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:50.752 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:50.752 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:51.691 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:51.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:51.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:51.790 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:51.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:51.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:51.842 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:51.852 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:51.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:51.860 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:51.860 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:51.916 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:51.916 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:51.917 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:51.917 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:51.940 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:51.940 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:51.940 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:51.997 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:51.997 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:51.998 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:51.998 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:52.917 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:52.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:52.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:53.015 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:53.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:53.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:53.066 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:53.075 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:53.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:53.084 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:53.084 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:53.141 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:53.141 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:53.141 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:53.141 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:53.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:53.162 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:53.162 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:53.219 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:53.220 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:53.220 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:53.220 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:54.142 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:54.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:54.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:54.241 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:54.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:54.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:54.294 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:54.302 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:54.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:54.311 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:54.311 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:54.367 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:54.368 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:54.368 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:54.368 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:54.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:54.381 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:54.381 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:54.438 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:54.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:54.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:54.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:55.369 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:55.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:55.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:55.466 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:55.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:55.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:55.517 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:55.526 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:55.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:55.534 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:55.534 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:55.590 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:55.591 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:55.591 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:55.591 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:55.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:55.602 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:55.603 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:55.660 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:55.660 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:55.660 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:55.660 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:56.591 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:56.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:56.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:56.691 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:56.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:56.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:56.744 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:56.752 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:56.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:56.761 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:56.761 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:56.819 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:56.819 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:56.819 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:56.819 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:56.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:56.829 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:56.829 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:56.886 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:56.887 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:56.887 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:56.887 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:57.820 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:57.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:57.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:57.919 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:57.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:57.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:57.971 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:57.980 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:57.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:57.990 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:57.990 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:58.048 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:58.048 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:58.048 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:58.048 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:58.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:58.066 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:58.066 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:58.123 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:58.124 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:58.124 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:58.124 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:59.048 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:59.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:59.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:59.147 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:59.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:59.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:59.199 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:51:59.207 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:51:59.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:51:59.217 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:59.217 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:51:59.274 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:59.274 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:59.274 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:59.274 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:59.282 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:51:59.282 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:59.282 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:51:59.338 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:59.339 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:59.339 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:59.339 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:00.276 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:00.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:00.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:00.374 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:00.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:00.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:00.426 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:00.435 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:00.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:00.485 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:00.485 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:00.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:00.516 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:00.517 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:00.542 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:00.542 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:00.542 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:00.542 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:00.573 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:00.574 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:00.574 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:00.574 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:01.543 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:01.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:01.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:01.641 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:01.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:01.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:01.694 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:01.702 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:01.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:01.711 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:01.711 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:01.768 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:01.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:01.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:01.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:01.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:01.778 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:01.778 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:01.835 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:01.835 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:01.835 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:01.835 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:02.769 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:02.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:02.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:02.836 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:02.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:02.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:02.842 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:02.897 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:02.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:02.919 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:02.919 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:02.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:02.972 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:02.972 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:02.976 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:02.976 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:02.976 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:02.976 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:03.029 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:03.029 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:03.029 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:03.029 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:03.976 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:03.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:03.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:04.075 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:04.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:04.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:04.127 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:04.136 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:04.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:04.145 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:04.145 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:04.202 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:04.202 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:04.202 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:04.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:04.208 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:04.208 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:04.208 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:04.265 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:04.265 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:04.265 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:04.265 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:05.203 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:05.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:05.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:05.302 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:05.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:05.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:05.355 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:05.364 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:05.372 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:05.372 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:05.372 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:05.430 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:05.430 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:05.430 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:05.430 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:05.453 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:05.453 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:05.453 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:05.510 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:05.511 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:05.511 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:05.511 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:06.430 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:06.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:06.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:06.529 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:06.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:06.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:06.581 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:06.590 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:06.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:06.599 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:06.599 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:06.657 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:06.657 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:06.657 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:06.657 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:06.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:06.671 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:06.671 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:06.729 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:06.729 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:06.729 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:06.729 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:07.659 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:07.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:07.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:07.757 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:07.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:07.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:07.809 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:07.817 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:07.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:07.826 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:07.826 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:07.883 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:07.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:07.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:07.883 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:07.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:07.895 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:07.895 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:07.953 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:07.954 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:07.954 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:07.954 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:08.884 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:08.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:08.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:08.955 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:08.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:08.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:08.959 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:09.015 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:09.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:09.034 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:09.034 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:09.091 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:09.091 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:09.091 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:09.091 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:09.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:09.099 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:09.099 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:09.156 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:09.156 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:09.156 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:09.156 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:10.092 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:10.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:10.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:10.158 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:10.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:10.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:10.221 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:10.229 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:10.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:10.239 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:10.239 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:10.295 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:10.295 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:10.295 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:10.295 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:10.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:10.304 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:10.304 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:10.362 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:10.362 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:10.362 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:10.362 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:11.296 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:11.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:11.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:11.376 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:11.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:11.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:11.447 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:11.456 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:11.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:11.465 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:11.465 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:11.522 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:11.523 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:11.523 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:11.523 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:11.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:11.539 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:11.539 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:11.597 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:11.597 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:11.597 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:11.597 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:12.524 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:12.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:12.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:12.622 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:12.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:12.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:12.675 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:12.683 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:12.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:12.692 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:12.692 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:12.749 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:12.750 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:12.750 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:12.750 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:12.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:12.761 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:12.761 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:12.819 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:12.820 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:12.820 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:12.820 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:13.750 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:13.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:13.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:13.848 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:13.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:13.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:13.900 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:13.909 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:13.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:13.918 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:13.918 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:13.974 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:13.975 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:13.975 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:13.975 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:13.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:13.999 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:13.999 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:14.056 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:14.056 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:14.056 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:14.057 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:14.975 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:14.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:14.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:15.036 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:15.058 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:15.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:15.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:15.118 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:15.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:15.128 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:15.128 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:15.185 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:15.185 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:15.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:15.185 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:15.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:15.192 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:15.192 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:15.249 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:15.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:15.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:15.250 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:16.185 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:16.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:16.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:16.247 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:16.251 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:16.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:16.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:16.314 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:16.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:16.336 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:16.336 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:16.392 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:16.392 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:16.392 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:16.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:16.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:16.400 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:16.400 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:16.458 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:16.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:16.458 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:16.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:17.394 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:17.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:17.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:17.493 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:17.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:17.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:17.546 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:17.554 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:17.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:17.563 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:17.563 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:17.619 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:17.619 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:17.619 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:17.620 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:17.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:17.640 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:17.640 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:17.696 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:17.697 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:17.697 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:17.697 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:18.621 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:18.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:18.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:18.720 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:18.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:18.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:18.772 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:18.781 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:18.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:18.791 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:18.791 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:18.848 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:18.848 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:18.848 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:18.848 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:18.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:18.873 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:18.873 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:18.931 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:18.931 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:18.932 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:18.932 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:19.849 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:19.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:19.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:19.948 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:19.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:19.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:20.001 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:20.009 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:20.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:20.018 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:20.018 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:20.074 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:20.074 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:20.074 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:20.074 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:20.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:20.084 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:20.084 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:20.142 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:20.142 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:20.142 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:20.142 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:21.075 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:21.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:21.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:21.174 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:21.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:21.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:21.226 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:21.235 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:21.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:21.244 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:21.244 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:21.301 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:21.301 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:21.301 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:21.301 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:21.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:21.318 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:21.318 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:21.375 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:21.375 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:21.375 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:21.375 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:22.301 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:22.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:22.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:22.401 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:22.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:22.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:22.453 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:22.462 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:22.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:22.471 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:22.471 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:22.528 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:22.528 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:22.528 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:22.528 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:22.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:22.547 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:22.547 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:22.604 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:22.604 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:22.604 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:22.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:23.529 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:23.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:23.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:23.627 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:23.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:23.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:23.678 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:23.686 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:23.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:23.736 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:23.736 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:23.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:23.770 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:23.770 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:23.793 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:23.793 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:23.793 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:23.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:23.828 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:23.828 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:23.828 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:23.828 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:24.794 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:24.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:24.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:24.893 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:24.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:24.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:24.946 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:24.954 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:24.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:24.963 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:24.963 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:25.019 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:25.019 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:25.020 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:25.020 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:25.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:25.038 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:25.038 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:25.095 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:25.095 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:25.096 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:25.096 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:26.020 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:26.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:26.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:26.119 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:26.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:26.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:26.172 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:26.180 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:26.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:26.189 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:26.189 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:26.246 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:26.246 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:26.246 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:26.246 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:26.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:26.257 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:26.257 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:26.314 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:26.315 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:26.315 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:26.315 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:27.247 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:27.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:27.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:27.347 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:27.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:27.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:27.399 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:27.407 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:27.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:27.457 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:27.457 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:27.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:27.489 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:27.489 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:27.515 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:27.515 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:27.515 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:27.515 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:27.546 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:27.546 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:27.546 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:27.546 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:28.515 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:28.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:28.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:28.614 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:28.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:28.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:28.666 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:28.675 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:28.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:28.684 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:28.684 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:28.741 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:28.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:28.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:28.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:28.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:28.758 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:28.758 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:28.815 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:28.815 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:28.815 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:28.815 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:29.742 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:29.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:29.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:29.839 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:29.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:29.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:29.891 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:29.899 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:29.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:29.909 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:29.909 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:29.966 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:29.966 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:29.966 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:29.966 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:29.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:29.973 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:29.974 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:30.032 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:30.032 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:30.033 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:30.033 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:30.966 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:30.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:30.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:31.064 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:31.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:31.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:31.117 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:31.126 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:31.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:31.134 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:31.134 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:31.190 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:31.190 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:31.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:31.191 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:31.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:31.199 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:31.199 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:31.256 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:31.256 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:31.256 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:31.256 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:32.192 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:32.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:32.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:32.289 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:32.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:32.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:32.342 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:32.351 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:32.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:32.359 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:32.359 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:32.415 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:32.415 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:32.415 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:32.415 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:32.439 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:32.439 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:32.439 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:32.497 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:32.497 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:32.497 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:32.497 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:33.416 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:33.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:33.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:33.511 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:33.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:33.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:33.563 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:33.572 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:33.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:33.581 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:33.581 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:33.637 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:33.637 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:33.637 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:33.637 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:33.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:33.650 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:33.650 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:33.708 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:33.708 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:33.708 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:33.708 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:34.638 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:34.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:34.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:34.737 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:34.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:34.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:34.789 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:34.797 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:34.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:34.806 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:34.806 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:34.862 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:34.862 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:34.862 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:34.862 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:34.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:34.875 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:34.875 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:34.932 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:34.933 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:34.933 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:34.933 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:35.863 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:35.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:35.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:35.962 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:35.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:35.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:36.014 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:36.023 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:36.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:36.032 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:36.032 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:36.088 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:36.088 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:36.088 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:36.088 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:36.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:36.112 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:36.112 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:36.169 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:36.169 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:36.169 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:36.169 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:37.090 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:37.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:37.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:37.188 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:37.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:37.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:37.241 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:37.249 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:37.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:37.258 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:37.258 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:37.314 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:37.314 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:37.314 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:37.314 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:37.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:37.331 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:37.331 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:37.387 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:37.388 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:37.388 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:37.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:38.315 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:38.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:38.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:38.378 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:38.389 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:38.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:38.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:38.454 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:38.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:38.464 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:38.464 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:38.520 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:38.520 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:38.520 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:38.520 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:38.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:38.541 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:38.541 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:38.597 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:38.598 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:38.598 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:38.598 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:39.521 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:39.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:39.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:39.616 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:39.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:39.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:39.668 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:39.677 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:39.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:39.685 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:39.685 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:39.741 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:39.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:39.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:39.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:39.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:39.754 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:39.754 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:39.811 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:39.812 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:39.812 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:39.812 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:40.742 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:40.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:40.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:40.840 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:40.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:40.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:40.893 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:40.901 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:40.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:40.910 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:40.910 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:40.967 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:40.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:40.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:40.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:40.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:40.985 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:40.986 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:41.043 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:41.043 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:41.043 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:41.043 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:41.968 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:41.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:41.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:42.049 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:42.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:42.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:42.101 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:42.110 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:42.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:42.118 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:42.118 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:42.174 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:42.174 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:42.174 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:42.174 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:42.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:42.198 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:42.198 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:42.255 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:42.256 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:42.256 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:42.256 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:43.175 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:43.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:43.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:43.249 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:43.257 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:43.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:43.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:43.321 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:43.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:43.334 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:43.334 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:43.391 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:43.392 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:43.392 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:43.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:43.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:43.400 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:43.400 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:43.457 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:43.457 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:43.457 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:43.457 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:44.392 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:44.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:44.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:44.489 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:44.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:44.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:44.541 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:44.550 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:44.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:44.559 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:44.559 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:44.616 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:44.616 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:44.616 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:44.616 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:44.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:44.622 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:44.622 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:44.680 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:44.680 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:44.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:44.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:45.616 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:45.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:45.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:45.715 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:45.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:45.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:45.766 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:45.775 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:45.783 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:45.783 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:45.783 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:45.840 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:45.840 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:45.840 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:45.840 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:45.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:45.849 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:45.849 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:45.907 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:45.907 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:45.908 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:45.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:46.841 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:46.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:46.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:46.939 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:46.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:46.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:46.991 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:47.000 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:47.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:47.050 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:47.050 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:47.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:47.078 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:47.078 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:47.106 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:47.107 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:47.107 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:47.107 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:47.134 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:47.135 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:47.135 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:47.135 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:48.108 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:48.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:48.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:48.207 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:48.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:48.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:48.259 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:48.268 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:48.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:48.277 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:48.277 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:48.334 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:48.334 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:48.334 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:48.334 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:48.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:48.355 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:48.355 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:48.412 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:48.412 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:48.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:48.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:49.335 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:49.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:49.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:49.414 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:49.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:49.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:49.422 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:49.475 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:49.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:49.496 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:49.496 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:49.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:49.551 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:49.551 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:49.553 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:49.553 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:49.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:49.553 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:49.607 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:49.608 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:49.608 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:49.608 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:50.554 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:50.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:50.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:50.643 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:50.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:50.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:50.697 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:50.705 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:50.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:50.714 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:50.714 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:50.771 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:50.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:50.772 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:50.772 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:50.790 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:50.790 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:50.790 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:50.847 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:50.847 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:50.847 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:50.848 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:51.773 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:51.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:51.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:51.847 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:51.849 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:51.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:51.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:51.913 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:51.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:51.922 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:51.922 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:51.978 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:51.979 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:51.979 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:51.979 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:51.991 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:51.991 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:51.991 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:52.049 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:52.049 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:52.049 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:52.050 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:52.980 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:52.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:52.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:53.078 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:53.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:53.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:53.130 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:53.138 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:53.147 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:53.147 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:53.147 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:53.203 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:53.203 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:53.203 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:53.203 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:53.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:53.212 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:53.212 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:53.269 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:53.269 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:53.270 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:53.270 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:54.204 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:54.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:54.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:54.303 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:54.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:54.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:54.363 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:54.372 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:54.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:54.381 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:54.381 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:54.438 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:54.438 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:54.438 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:54.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:54.447 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:54.447 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:54.447 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:54.505 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:54.505 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:54.505 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:54.505 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:55.439 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:55.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:55.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:55.537 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:55.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:55.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:55.589 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:55.598 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:55.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:55.606 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:55.607 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:55.663 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:55.664 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:55.664 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:55.664 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:55.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:55.678 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:55.678 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:55.735 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:55.735 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:55.735 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:55.736 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:56.664 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:56.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:56.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:56.780 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:56.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:56.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:56.790 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:56.846 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:56.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:56.877 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:56.877 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:56.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:56.919 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:56.919 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:56.934 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:56.934 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:56.934 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:56.934 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:56.977 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:56.977 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:56.977 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:56.977 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:57.935 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:57.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:57.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:58.033 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:58.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:58.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:58.086 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:58.095 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:58.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:58.103 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:58.103 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:58.161 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:58.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:58.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:58.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:58.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:58.170 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:58.170 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:58.228 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:58.228 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:58.228 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:58.228 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:59.162 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:59.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:59.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:59.260 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:59.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:59.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:59.313 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:52:59.321 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:52:59.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:52:59.331 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:59.331 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:52:59.387 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:59.387 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:59.387 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:59.387 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:59.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:52:59.395 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:59.395 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:52:59.453 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:59.454 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:59.454 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:59.454 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:00.389 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:00.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:00.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:00.487 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:00.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:00.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:00.539 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:00.548 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:00.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:00.556 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:00.557 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:00.613 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:00.614 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:00.614 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:00.614 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:00.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:00.622 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:00.622 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:00.680 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:00.680 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:00.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:00.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:01.614 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:01.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:01.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:01.712 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:01.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:01.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:01.764 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:01.773 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:01.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:01.782 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:01.782 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:01.838 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:01.839 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:01.839 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:01.839 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:01.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:01.847 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:01.847 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:01.903 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:01.904 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:01.904 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:01.904 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:02.840 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:02.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:02.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:02.938 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:02.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:02.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:02.992 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:03.000 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:03.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:03.009 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:03.009 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:03.065 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:03.065 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:03.065 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:03.066 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:03.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:03.080 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:03.080 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:03.137 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:03.137 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:03.137 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:03.137 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:04.066 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:04.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:04.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:04.165 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:04.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:04.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:04.217 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:04.225 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:04.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:04.234 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:04.234 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:04.291 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:04.291 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:04.291 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:04.291 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:04.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:04.312 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:04.312 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:04.369 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:04.369 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:04.369 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:04.369 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:05.292 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:05.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:05.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:05.390 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:05.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:05.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:05.440 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:05.449 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:05.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:05.458 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:05.458 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:05.514 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:05.514 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:05.514 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:05.514 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:05.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:05.535 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:05.535 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:05.592 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:05.592 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:05.592 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:05.592 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:06.515 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:06.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:06.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:06.580 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:06.594 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:06.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:06.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:06.659 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:06.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:06.666 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:06.666 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:06.724 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:06.724 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:06.724 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:06.724 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:06.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:06.734 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:06.734 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:06.792 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:06.792 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:06.792 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:06.792 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:07.725 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:07.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:07.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:07.824 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:07.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:07.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:07.876 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:07.884 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:07.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:07.894 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:07.894 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:07.951 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:07.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:07.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:07.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:07.956 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:07.956 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:07.956 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:08.014 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:08.014 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:08.014 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:08.014 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:08.952 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:08.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:08.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:09.051 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:09.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:09.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:09.104 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:09.112 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:09.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:09.121 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:09.121 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:09.178 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:09.178 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:09.178 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:09.178 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:09.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:09.189 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:09.189 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:09.245 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:09.245 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:09.245 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:09.245 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:10.179 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:10.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:10.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:10.277 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:10.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:10.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:10.330 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:10.338 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:10.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:10.347 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:10.347 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:10.404 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:10.404 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:10.404 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:10.405 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:10.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:10.424 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:10.424 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:10.481 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:10.481 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:10.481 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:10.482 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:11.405 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:11.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:11.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:11.503 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:11.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:11.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:11.556 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:11.564 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:11.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:11.573 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:11.573 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:11.630 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:11.630 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:11.630 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:11.630 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:11.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:11.650 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:11.650 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:11.708 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:11.708 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:11.708 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:11.709 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:12.631 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:12.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:12.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:12.721 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:12.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:12.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:12.773 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:12.782 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:12.790 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:12.790 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:12.790 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:12.847 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:12.847 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:12.847 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:12.847 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:12.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:12.856 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:12.856 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:12.913 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:12.913 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:12.913 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:12.913 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:13.847 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:13.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:13.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:13.947 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:13.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:13.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:13.999 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:14.008 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:14.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:14.017 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:14.017 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:14.073 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:14.073 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:14.073 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:14.073 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:14.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:14.092 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:14.092 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:14.148 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:14.149 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:14.149 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:14.149 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:15.074 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:15.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:15.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:15.173 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:15.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:15.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:15.225 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:15.234 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:15.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:15.243 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:15.243 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:15.299 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:15.299 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:15.299 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:15.299 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:15.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:15.311 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:15.311 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:15.367 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:15.367 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:15.367 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:15.367 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:16.300 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:16.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:16.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:16.399 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:16.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:16.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:16.450 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:16.459 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:16.467 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:16.468 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:16.468 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:16.525 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:16.525 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:16.525 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:16.525 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:16.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:16.537 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:16.537 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:16.593 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:16.593 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:16.593 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:16.593 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:17.526 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:17.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:17.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:17.601 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:17.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:17.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:17.654 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:17.663 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:17.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:17.673 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:17.673 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:17.730 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:17.730 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:17.730 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:17.730 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:17.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:17.738 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:17.738 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:17.795 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:17.796 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:17.796 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:17.796 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:18.731 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:18.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:18.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:18.829 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:18.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:18.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:18.882 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:18.890 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:18.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:18.899 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:18.899 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:18.956 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:18.957 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:18.957 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:18.957 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:18.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:18.972 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:18.972 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:19.030 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:19.030 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:19.031 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:19.031 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:19.957 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:19.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:19.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:20.045 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:20.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:20.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:20.097 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:20.105 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:20.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:20.114 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:20.114 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:20.170 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:20.170 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:20.170 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:20.170 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:20.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:20.181 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:20.181 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:20.238 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:20.238 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:20.238 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:20.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:21.172 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:21.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:21.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:21.268 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:21.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:21.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:21.319 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:21.327 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:21.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:21.377 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:21.377 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:21.401 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:21.401 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:21.401 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:21.434 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:21.434 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:21.434 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:21.434 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:21.458 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:21.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:21.458 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:21.458 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:22.435 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:22.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:22.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:22.534 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:22.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:22.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:22.586 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:22.594 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:22.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:22.604 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:22.604 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:22.661 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:22.661 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:22.661 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:22.661 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:22.676 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:22.676 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:22.676 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:22.734 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:22.734 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:22.734 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:22.734 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:23.662 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:23.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:23.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:23.740 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:23.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:23.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:23.792 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:23.800 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:23.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:23.809 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:23.809 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:23.866 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:23.866 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:23.866 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:23.866 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:23.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:23.885 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:23.885 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:23.942 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:23.942 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:23.942 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:23.942 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:24.867 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:24.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:24.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:24.944 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:24.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:24.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:24.950 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:25.004 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:25.026 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:25.030 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:25.030 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:25.083 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:25.083 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:25.083 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:25.083 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:25.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:25.093 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:25.093 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:25.150 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:25.150 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:25.150 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:25.150 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:26.085 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:26.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:26.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:26.151 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:26.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:26.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:26.153 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:26.212 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:26.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:26.225 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:26.226 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:26.283 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:26.283 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:26.283 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:26.283 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:26.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:26.285 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:26.285 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:26.342 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:26.342 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:26.343 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:26.343 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:27.284 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:27.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:27.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:27.347 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:27.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:27.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:27.398 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:27.407 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:27.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:27.454 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:27.454 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:27.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:27.478 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:27.478 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:27.512 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:27.512 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:27.512 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:27.512 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:27.536 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:27.536 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:27.536 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:27.536 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:28.513 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:28.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:28.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:28.591 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:28.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:28.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:28.642 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:28.651 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:28.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:28.700 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:28.700 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:28.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:28.727 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:28.727 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:28.757 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:28.757 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:28.757 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:28.757 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:28.783 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:28.784 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:28.784 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:28.784 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:29.758 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:29.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:29.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:29.846 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:29.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:29.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:29.897 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:29.906 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:29.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:29.914 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:29.914 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:29.971 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:29.971 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:29.971 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:29.971 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:29.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:29.985 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:29.985 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:30.041 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:30.042 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:30.042 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:30.042 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:30.972 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:30.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:30.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:31.042 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:31.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:31.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:31.050 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:31.116 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:31.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:31.136 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:31.136 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:31.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:31.189 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:31.189 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:31.192 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:31.192 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.192 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:31.192 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:31.247 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:31.247 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.247 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:31.247 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:32.193 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:32.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:32.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:32.291 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:32.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:32.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:32.344 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:32.352 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:32.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:32.361 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:32.361 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:32.417 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:32.417 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:32.417 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:32.417 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:32.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:32.437 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:32.437 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:32.494 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:32.494 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:32.494 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:32.495 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:33.419 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:33.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:33.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:33.518 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:33.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:33.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:33.570 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:33.579 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:33.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:33.588 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:33.588 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:33.645 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:33.645 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:33.645 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:33.645 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:33.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:33.656 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:33.656 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:33.713 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:33.714 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:33.714 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:33.714 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:34.646 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:34.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:34.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:34.750 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:34.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:34.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:34.800 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:34.809 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:34.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:34.818 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:34.818 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:34.875 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:34.875 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:34.875 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:34.875 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:34.893 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:34.893 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:34.894 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:34.950 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:34.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:34.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:34.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:35.877 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:35.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:35.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:35.949 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:35.952 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:35.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:35.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:36.012 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:36.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:36.028 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:36.029 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:36.086 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:36.086 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:36.086 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:36.086 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:36.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:36.091 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:36.091 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:36.148 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:36.148 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:36.148 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:36.148 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:37.087 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:37.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:37.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:37.180 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:37.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:37.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:37.231 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:37.240 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:37.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:37.290 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:37.290 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:37.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:37.311 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:37.311 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:37.346 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:37.347 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:37.347 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:37.347 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:37.368 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:37.368 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:37.368 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:37.368 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:38.347 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:38.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:38.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:38.416 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:38.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:38.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:38.467 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:38.476 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:38.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:38.486 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:38.486 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:38.543 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:38.543 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:38.543 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:38.543 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:38.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:38.564 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:38.564 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:38.622 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:38.622 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:38.622 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:38.622 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:39.544 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:39.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:39.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:39.651 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:39.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:39.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:39.702 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:39.710 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:39.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:39.760 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:39.760 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:39.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:39.796 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:39.796 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:39.818 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:39.819 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:39.819 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:39.819 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:39.852 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:39.852 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:39.853 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:39.853 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:40.820 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:40.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:40.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:40.907 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:40.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:40.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:40.958 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:40.967 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:41.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:41.016 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:41.016 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:41.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:41.042 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:41.042 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:41.074 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:41.074 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:41.074 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:41.074 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:41.099 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:41.099 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:41.100 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:41.100 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:42.074 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:42.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:42.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:42.166 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:42.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:42.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:42.217 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:42.225 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:42.276 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:42.276 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:42.276 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:42.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:42.304 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:42.304 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:42.332 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:42.333 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:42.333 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:42.333 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:42.361 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:42.361 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:42.361 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:42.361 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:43.333 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:43.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:43.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:43.432 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:43.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:43.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:43.484 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:43.493 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:43.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:43.502 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:43.502 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:43.558 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:43.559 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:43.559 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:43.559 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:43.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:43.569 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:43.569 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:43.626 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:43.627 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:43.627 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:43.627 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:44.559 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:44.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:44.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:44.658 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:44.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:44.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:44.710 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:44.718 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:44.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:44.727 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:44.727 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:44.784 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:44.784 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:44.784 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:44.784 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:44.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:44.810 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:44.811 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:44.869 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:44.870 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:44.870 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:44.870 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:45.786 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:45.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:45.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:45.886 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:45.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:45.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:45.939 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-12T22:53:45.947 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-12T22:53:45.956 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-12T22:53:45.956 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:45.957 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-12T22:53:46.013 INFO:teuthology.orchestra.run.trial160.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:46.013 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:46.013 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:46.013 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:46.014 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:46.015 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:53:46.030 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:53:46.061 INFO:teuthology.run:Summary data: description: fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/rpm_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:53:46.062 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:53:46.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-12T22:53:46.067 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:46.067 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-12T22:53:46.161 INFO:teuthology.orchestra.run.trial026.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:46.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:46.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:46.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:46.183 INFO:teuthology.run:FAIL