2026-02-12T22:08:53.280 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:08:53.296 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:08:53.380 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47134 branch: wip-pdonnell-testing-20260210.171210 description: fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/charmap} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47134' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds use global snaprealm seq for subvol: false mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial024.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLrqmgjSjweTqLETjVwo059Dq8eGHdHN6AdlHjOiV8Tozzb8a6/H2Ay3qBi3IMBcqivGXkabAUOLuhMpYTu34M8= trial168.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP+T3S5T3ZT/YIQLbe0D2oxTUQpMbU2+Qc9vw884LQ+l5XX32mxf+3AOur32nUF5dtUzEXss/3sA7D8oPaNYNu0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_dir_charmap teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end - if not is_fuse() then reject() end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:08:53.380 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:08:53.380 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:08:53.380 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:08:53.382 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:08:53.382 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:08:53.382 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:08:53.382 INFO:teuthology.packaging:ref: None 2026-02-12T22:08:53.382 INFO:teuthology.packaging:tag: None 2026-02-12T22:08:53.382 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:08:53.382 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:08:53.382 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:08:53.498 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:08:53.499 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:08:53.510 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:08:53.510 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:08:53.525 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:08:53.541 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:08:53.553 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:08:53.629 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial024.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47134', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:05:30.096583', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLrqmgjSjweTqLETjVwo059Dq8eGHdHN6AdlHjOiV8Tozzb8a6/H2Ay3qBi3IMBcqivGXkabAUOLuhMpYTu34M8='} 2026-02-12T22:08:53.685 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial168.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47134', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:05:30.095941', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP+T3S5T3ZT/YIQLbe0D2oxTUQpMbU2+Qc9vw884LQ+l5XX32mxf+3AOur32nUF5dtUzEXss/3sA7D8oPaNYNu0='} 2026-02-12T22:08:53.685 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:08:53.739 INFO:teuthology.task.internal:roles: ubuntu@trial024.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2026-02-12T22:08:53.739 INFO:teuthology.task.internal:roles: ubuntu@trial168.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2026-02-12T22:08:53.739 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:08:53.882 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ebe47fdad40>, signals=[15]) 2026-02-12T22:08:53.883 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:08:53.894 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:08:53.894 DEBUG:teuthology.task.internal:connecting to ubuntu@trial024.front.sepia.ceph.com 2026-02-12T22:08:53.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:53.955 DEBUG:teuthology.task.internal:connecting to ubuntu@trial168.front.sepia.ceph.com 2026-02-12T22:08:53.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:54.015 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:08:54.030 DEBUG:teuthology.orchestra.run.trial024:> uname -m 2026-02-12T22:08:54.048 INFO:teuthology.orchestra.run.trial024.stdout:x86_64 2026-02-12T22:08:54.048 DEBUG:teuthology.orchestra.run.trial024:> cat /etc/os-release 2026-02-12T22:08:54.104 INFO:teuthology.orchestra.run.trial024.stdout:NAME="Rocky Linux" 2026-02-12T22:08:54.104 INFO:teuthology.orchestra.run.trial024.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:08:54.104 INFO:teuthology.orchestra.run.trial024.stdout:ID="rocky" 2026-02-12T22:08:54.104 INFO:teuthology.orchestra.run.trial024.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:08:54.104 INFO:teuthology.orchestra.run.trial024.stdout:VERSION_ID="10.1" 2026-02-12T22:08:54.104 INFO:teuthology.orchestra.run.trial024.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:08:54.104 INFO:teuthology.orchestra.run.trial024.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:08:54.104 INFO:teuthology.orchestra.run.trial024.stdout:ANSI_COLOR="0;32" 2026-02-12T22:08:54.104 INFO:teuthology.orchestra.run.trial024.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:08:54.104 INFO:teuthology.orchestra.run.trial024.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:08:54.104 INFO:teuthology.orchestra.run.trial024.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:08:54.105 INFO:teuthology.orchestra.run.trial024.stdout:VENDOR_NAME="RESF" 2026-02-12T22:08:54.105 INFO:teuthology.orchestra.run.trial024.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:08:54.105 INFO:teuthology.orchestra.run.trial024.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:08:54.105 INFO:teuthology.orchestra.run.trial024.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:08:54.105 INFO:teuthology.orchestra.run.trial024.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:08:54.105 INFO:teuthology.orchestra.run.trial024.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:08:54.105 INFO:teuthology.orchestra.run.trial024.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:08:54.105 INFO:teuthology.orchestra.run.trial024.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:08:54.105 INFO:teuthology.lock.ops:Updating trial024.front.sepia.ceph.com on lock server 2026-02-12T22:08:54.175 DEBUG:teuthology.orchestra.run.trial168:> uname -m 2026-02-12T22:08:54.191 INFO:teuthology.orchestra.run.trial168.stdout:x86_64 2026-02-12T22:08:54.191 DEBUG:teuthology.orchestra.run.trial168:> cat /etc/os-release 2026-02-12T22:08:54.248 INFO:teuthology.orchestra.run.trial168.stdout:NAME="Rocky Linux" 2026-02-12T22:08:54.248 INFO:teuthology.orchestra.run.trial168.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:08:54.248 INFO:teuthology.orchestra.run.trial168.stdout:ID="rocky" 2026-02-12T22:08:54.248 INFO:teuthology.orchestra.run.trial168.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:08:54.248 INFO:teuthology.orchestra.run.trial168.stdout:VERSION_ID="10.1" 2026-02-12T22:08:54.248 INFO:teuthology.orchestra.run.trial168.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:08:54.248 INFO:teuthology.orchestra.run.trial168.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:08:54.248 INFO:teuthology.orchestra.run.trial168.stdout:ANSI_COLOR="0;32" 2026-02-12T22:08:54.249 INFO:teuthology.orchestra.run.trial168.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:08:54.249 INFO:teuthology.orchestra.run.trial168.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:08:54.249 INFO:teuthology.orchestra.run.trial168.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:08:54.249 INFO:teuthology.orchestra.run.trial168.stdout:VENDOR_NAME="RESF" 2026-02-12T22:08:54.249 INFO:teuthology.orchestra.run.trial168.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:08:54.249 INFO:teuthology.orchestra.run.trial168.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:08:54.249 INFO:teuthology.orchestra.run.trial168.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:08:54.249 INFO:teuthology.orchestra.run.trial168.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:08:54.249 INFO:teuthology.orchestra.run.trial168.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:08:54.249 INFO:teuthology.orchestra.run.trial168.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:08:54.249 INFO:teuthology.orchestra.run.trial168.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:08:54.249 INFO:teuthology.lock.ops:Updating trial168.front.sepia.ceph.com on lock server 2026-02-12T22:08:54.324 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:08:54.337 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:08:54.349 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:08:54.349 DEBUG:teuthology.orchestra.run.trial024:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:08:54.351 DEBUG:teuthology.orchestra.run.trial168:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:08:54.366 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:08:54.378 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:08:54.378 DEBUG:teuthology.orchestra.run.trial024:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:08:54.407 DEBUG:teuthology.orchestra.run.trial168:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:08:54.423 INFO:teuthology.orchestra.run.trial024.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:08:54.425 INFO:teuthology.orchestra.run.trial168.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:08:54.425 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:08:54.592 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:08:54.612 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:08:54.612 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:08:54.612 DEBUG:teuthology.orchestra.run.trial024:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:08:54.612 DEBUG:teuthology.orchestra.run.trial168:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:08:54.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:08:54.628 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:08:54.629 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:08:54.629 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:08:54.686 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:54.686 INFO:teuthology.task.kernel:Running kernel on trial168: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:54.686 DEBUG:teuthology.orchestra.run.trial168:> sudo yum install -y kernel 2026-02-12T22:08:54.687 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:54.687 INFO:teuthology.task.kernel:Running kernel on trial024: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:54.687 DEBUG:teuthology.orchestra.run.trial024:> sudo yum install -y kernel 2026-02-12T22:08:55.190 INFO:teuthology.orchestra.run.trial024.stdout:Rocky Linux 10 - AppStream 21 MB/s | 2.2 MB 00:00 2026-02-12T22:08:55.534 INFO:teuthology.orchestra.run.trial168.stdout:Rocky Linux 10 - AppStream 4.9 MB/s | 2.2 MB 00:00 2026-02-12T22:08:56.107 INFO:teuthology.orchestra.run.trial168.stdout:Rocky Linux 10 - BaseOS 25 MB/s | 11 MB 00:00 2026-02-12T22:08:56.326 INFO:teuthology.orchestra.run.trial024.stdout:Rocky Linux 10 - BaseOS 11 MB/s | 11 MB 00:01 2026-02-12T22:08:56.632 INFO:teuthology.orchestra.run.trial168.stdout:Rocky Linux 10 - CRB 4.5 MB/s | 503 kB 00:00 2026-02-12T22:08:56.813 INFO:teuthology.orchestra.run.trial024.stdout:Rocky Linux 10 - CRB 6.9 MB/s | 503 kB 00:00 2026-02-12T22:08:57.352 INFO:teuthology.orchestra.run.trial168.stdout:Extra Packages for Enterprise Linux 9.2 MB/s | 6.2 MB 00:00 2026-02-12T22:08:57.474 INFO:teuthology.orchestra.run.trial024.stdout:Extra Packages for Enterprise Linux 10 MB/s | 6.2 MB 00:00 2026-02-12T22:08:58.034 INFO:teuthology.orchestra.run.trial168.stdout:lab-extras 111 kB/s | 3.7 kB 00:00 2026-02-12T22:08:58.127 INFO:teuthology.orchestra.run.trial024.stdout:lab-extras 297 kB/s | 3.7 kB 00:00 2026-02-12T22:08:58.450 INFO:teuthology.orchestra.run.trial168.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:08:58.462 INFO:teuthology.orchestra.run.trial168.stdout:Dependencies resolved. 2026-02-12T22:08:58.463 INFO:teuthology.orchestra.run.trial168.stdout:================================================================================ 2026-02-12T22:08:58.463 INFO:teuthology.orchestra.run.trial168.stdout: Package Arch Version Repo Size 2026-02-12T22:08:58.463 INFO:teuthology.orchestra.run.trial168.stdout:================================================================================ 2026-02-12T22:08:58.463 INFO:teuthology.orchestra.run.trial168.stdout:Installing: 2026-02-12T22:08:58.463 INFO:teuthology.orchestra.run.trial168.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:08:58.463 INFO:teuthology.orchestra.run.trial168.stdout:Installing dependencies: 2026-02-12T22:08:58.463 INFO:teuthology.orchestra.run.trial168.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:08:58.464 INFO:teuthology.orchestra.run.trial168.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:08:58.464 INFO:teuthology.orchestra.run.trial168.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:08:58.464 INFO:teuthology.orchestra.run.trial168.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:08:58.464 INFO:teuthology.orchestra.run.trial168.stdout: 2026-02-12T22:08:58.464 INFO:teuthology.orchestra.run.trial168.stdout:Transaction Summary 2026-02-12T22:08:58.464 INFO:teuthology.orchestra.run.trial168.stdout:================================================================================ 2026-02-12T22:08:58.464 INFO:teuthology.orchestra.run.trial168.stdout:Install 5 Packages 2026-02-12T22:08:58.464 INFO:teuthology.orchestra.run.trial168.stdout: 2026-02-12T22:08:58.464 INFO:teuthology.orchestra.run.trial168.stdout:Total download size: 93 M 2026-02-12T22:08:58.464 INFO:teuthology.orchestra.run.trial168.stdout:Installed size: 135 M 2026-02-12T22:08:58.464 INFO:teuthology.orchestra.run.trial168.stdout:Downloading Packages: 2026-02-12T22:08:58.543 INFO:teuthology.orchestra.run.trial024.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:08:58.554 INFO:teuthology.orchestra.run.trial024.stdout:Dependencies resolved. 2026-02-12T22:08:58.555 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-12T22:08:58.556 INFO:teuthology.orchestra.run.trial024.stdout: Package Arch Version Repo Size 2026-02-12T22:08:58.556 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-12T22:08:58.556 INFO:teuthology.orchestra.run.trial024.stdout:Installing: 2026-02-12T22:08:58.556 INFO:teuthology.orchestra.run.trial024.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:08:58.556 INFO:teuthology.orchestra.run.trial024.stdout:Installing dependencies: 2026-02-12T22:08:58.556 INFO:teuthology.orchestra.run.trial024.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:08:58.556 INFO:teuthology.orchestra.run.trial024.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:08:58.556 INFO:teuthology.orchestra.run.trial024.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:08:58.556 INFO:teuthology.orchestra.run.trial024.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:08:58.556 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-12T22:08:58.557 INFO:teuthology.orchestra.run.trial024.stdout:Transaction Summary 2026-02-12T22:08:58.557 INFO:teuthology.orchestra.run.trial024.stdout:================================================================================ 2026-02-12T22:08:58.557 INFO:teuthology.orchestra.run.trial024.stdout:Install 5 Packages 2026-02-12T22:08:58.557 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-12T22:08:58.557 INFO:teuthology.orchestra.run.trial024.stdout:Total download size: 93 M 2026-02-12T22:08:58.557 INFO:teuthology.orchestra.run.trial024.stdout:Installed size: 135 M 2026-02-12T22:08:58.557 INFO:teuthology.orchestra.run.trial024.stdout:Downloading Packages: 2026-02-12T22:08:58.645 INFO:teuthology.orchestra.run.trial168.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 7.6 MB/s | 1.4 MB 00:00 2026-02-12T22:08:58.700 INFO:teuthology.orchestra.run.trial024.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 9.6 MB/s | 1.4 MB 00:00 2026-02-12T22:08:58.795 INFO:teuthology.orchestra.run.trial168.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 56 MB/s | 18 MB 00:00 2026-02-12T22:08:58.852 INFO:teuthology.orchestra.run.trial168.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 50 MB/s | 2.8 MB 00:00 2026-02-12T22:08:58.857 INFO:teuthology.orchestra.run.trial024.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 61 MB/s | 18 MB 00:00 2026-02-12T22:08:58.915 INFO:teuthology.orchestra.run.trial024.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 49 MB/s | 2.8 MB 00:00 2026-02-12T22:08:59.103 INFO:teuthology.orchestra.run.trial168.stdout:(4/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 64 MB/s | 41 MB 00:00 2026-02-12T22:08:59.145 INFO:teuthology.orchestra.run.trial168.stdout:(5/5): kernel-modules-core-6.12.0-124.31.1.el10 59 MB/s | 30 MB 00:00 2026-02-12T22:08:59.145 INFO:teuthology.orchestra.run.trial168.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:08:59.146 INFO:teuthology.orchestra.run.trial168.stdout:Total 136 MB/s | 93 MB 00:00 2026-02-12T22:08:59.146 INFO:teuthology.orchestra.run.trial168.stdout:Running transaction check 2026-02-12T22:08:59.148 INFO:teuthology.orchestra.run.trial024.stdout:(4/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 69 MB/s | 41 MB 00:00 2026-02-12T22:08:59.208 INFO:teuthology.orchestra.run.trial024.stdout:(5/5): kernel-modules-core-6.12.0-124.31.1.el10 58 MB/s | 30 MB 00:00 2026-02-12T22:08:59.209 INFO:teuthology.orchestra.run.trial024.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:08:59.209 INFO:teuthology.orchestra.run.trial024.stdout:Total 142 MB/s | 93 MB 00:00 2026-02-12T22:08:59.209 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction check 2026-02-12T22:08:59.292 INFO:teuthology.orchestra.run.trial168.stdout:Transaction check succeeded. 2026-02-12T22:08:59.293 INFO:teuthology.orchestra.run.trial168.stdout:Running transaction test 2026-02-12T22:08:59.355 INFO:teuthology.orchestra.run.trial024.stdout:Transaction check succeeded. 2026-02-12T22:08:59.355 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction test 2026-02-12T22:08:59.696 INFO:teuthology.orchestra.run.trial168.stdout:Transaction test succeeded. 2026-02-12T22:08:59.696 INFO:teuthology.orchestra.run.trial168.stdout:Running transaction 2026-02-12T22:08:59.758 INFO:teuthology.orchestra.run.trial024.stdout:Transaction test succeeded. 2026-02-12T22:08:59.758 INFO:teuthology.orchestra.run.trial024.stdout:Running transaction 2026-02-12T22:09:00.396 INFO:teuthology.orchestra.run.trial168.stdout: Preparing : 1/1 2026-02-12T22:09:00.451 INFO:teuthology.orchestra.run.trial024.stdout: Preparing : 1/1 2026-02-12T22:09:00.597 INFO:teuthology.orchestra.run.trial168.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:09:00.618 INFO:teuthology.orchestra.run.trial168.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:09:00.653 INFO:teuthology.orchestra.run.trial024.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:09:00.675 INFO:teuthology.orchestra.run.trial024.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:09:01.871 INFO:teuthology.orchestra.run.trial168.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:09:01.898 INFO:teuthology.orchestra.run.trial168.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:09:01.935 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:09:01.962 INFO:teuthology.orchestra.run.trial024.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:09:03.744 INFO:teuthology.orchestra.run.trial168.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:09:03.750 INFO:teuthology.orchestra.run.trial168.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:09:03.805 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:09:03.811 INFO:teuthology.orchestra.run.trial024.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:09:05.608 INFO:teuthology.orchestra.run.trial168.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:09:05.617 INFO:teuthology.orchestra.run.trial168.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:05.669 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:09:05.679 INFO:teuthology.orchestra.run.trial024.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:07.478 INFO:teuthology.orchestra.run.trial168.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:07.544 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:41.235 INFO:teuthology.orchestra.run.trial168.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:41.256 INFO:teuthology.orchestra.run.trial168.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:41.291 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:41.313 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:41.488 INFO:teuthology.orchestra.run.trial168.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:41.489 INFO:teuthology.orchestra.run.trial168.stdout: 2026-02-12T22:09:41.489 INFO:teuthology.orchestra.run.trial168.stdout:Installed: 2026-02-12T22:09:41.489 INFO:teuthology.orchestra.run.trial168.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.489 INFO:teuthology.orchestra.run.trial168.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.489 INFO:teuthology.orchestra.run.trial168.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.489 INFO:teuthology.orchestra.run.trial168.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.489 INFO:teuthology.orchestra.run.trial168.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.489 INFO:teuthology.orchestra.run.trial168.stdout: 2026-02-12T22:09:41.489 INFO:teuthology.orchestra.run.trial168.stdout:Complete! 2026-02-12T22:09:41.547 INFO:teuthology.orchestra.run.trial024.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:41.547 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-12T22:09:41.547 INFO:teuthology.orchestra.run.trial024.stdout:Installed: 2026-02-12T22:09:41.548 INFO:teuthology.orchestra.run.trial024.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.548 INFO:teuthology.orchestra.run.trial024.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.548 INFO:teuthology.orchestra.run.trial024.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.548 INFO:teuthology.orchestra.run.trial024.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.548 INFO:teuthology.orchestra.run.trial024.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.548 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-12T22:09:41.548 INFO:teuthology.orchestra.run.trial024.stdout:Complete! 2026-02-12T22:09:41.551 DEBUG:teuthology.orchestra.run.trial168:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:09:41.611 DEBUG:teuthology.orchestra.run.trial024:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:09:41.624 INFO:teuthology.orchestra.run.trial168.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.625 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.625 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.626 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:09:41.626 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:09:41.626 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:09:41.626 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial168.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:09:41.626 DEBUG:teuthology.orchestra.run.trial168:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:09:41.686 INFO:teuthology.orchestra.run.trial024.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.687 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.687 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.687 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:09:41.687 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:09:41.688 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:09:41.688 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial024.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:09:41.688 DEBUG:teuthology.orchestra.run.trial024:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:09:41.698 INFO:teuthology.orchestra.run.trial168.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.699 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.699 DEBUG:teuthology.orchestra.run.trial168:> sudo rpm -qi grub2-tools 2026-02-12T22:09:41.760 INFO:teuthology.orchestra.run.trial024.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.761 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.761 DEBUG:teuthology.orchestra.run.trial024:> sudo rpm -qi grub2-tools 2026-02-12T22:09:41.771 INFO:teuthology.orchestra.run.trial168.stdout:Name : grub2-tools 2026-02-12T22:09:41.771 INFO:teuthology.orchestra.run.trial168.stdout:Epoch : 1 2026-02-12T22:09:41.771 INFO:teuthology.orchestra.run.trial168.stdout:Version : 2.12 2026-02-12T22:09:41.771 INFO:teuthology.orchestra.run.trial168.stdout:Release : 29.el10_1 2026-02-12T22:09:41.771 INFO:teuthology.orchestra.run.trial168.stdout:Architecture: x86_64 2026-02-12T22:09:41.771 INFO:teuthology.orchestra.run.trial168.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:09:41.772 INFO:teuthology.orchestra.run.trial168.stdout:Group : Unspecified 2026-02-12T22:09:41.772 INFO:teuthology.orchestra.run.trial168.stdout:Size : 7963769 2026-02-12T22:09:41.772 INFO:teuthology.orchestra.run.trial168.stdout:License : GPL-3.0-or-later 2026-02-12T22:09:41.772 INFO:teuthology.orchestra.run.trial168.stdout:Signature : 2026-02-12T22:09:41.772 INFO:teuthology.orchestra.run.trial168.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:09:41.772 INFO:teuthology.orchestra.run.trial168.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:09:41.772 INFO:teuthology.orchestra.run.trial168.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:09:41.772 INFO:teuthology.orchestra.run.trial168.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:09:41.772 INFO:teuthology.orchestra.run.trial168.stdout:Packager : Release Engineering 2026-02-12T22:09:41.772 INFO:teuthology.orchestra.run.trial168.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:09:41.772 INFO:teuthology.orchestra.run.trial168.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:09:41.772 INFO:teuthology.orchestra.run.trial168.stdout:Summary : Support tools for GRUB. 2026-02-12T22:09:41.773 INFO:teuthology.orchestra.run.trial168.stdout:Description : 2026-02-12T22:09:41.773 INFO:teuthology.orchestra.run.trial168.stdout: 2026-02-12T22:09:41.773 INFO:teuthology.orchestra.run.trial168.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:09:41.773 INFO:teuthology.orchestra.run.trial168.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:09:41.773 INFO:teuthology.orchestra.run.trial168.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:09:41.773 INFO:teuthology.orchestra.run.trial168.stdout:hardware devices. 2026-02-12T22:09:41.773 INFO:teuthology.orchestra.run.trial168.stdout: 2026-02-12T22:09:41.773 INFO:teuthology.orchestra.run.trial168.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:09:41.774 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:09:41.774 INFO:teuthology.task.kernel:Updating grub on trial168 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.775 DEBUG:teuthology.orchestra.run.trial168:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:09:41.832 INFO:teuthology.orchestra.run.trial024.stdout:Name : grub2-tools 2026-02-12T22:09:41.832 INFO:teuthology.orchestra.run.trial024.stdout:Epoch : 1 2026-02-12T22:09:41.832 INFO:teuthology.orchestra.run.trial024.stdout:Version : 2.12 2026-02-12T22:09:41.832 INFO:teuthology.orchestra.run.trial024.stdout:Release : 29.el10_1 2026-02-12T22:09:41.832 INFO:teuthology.orchestra.run.trial024.stdout:Architecture: x86_64 2026-02-12T22:09:41.832 INFO:teuthology.orchestra.run.trial024.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:09:41.832 INFO:teuthology.orchestra.run.trial024.stdout:Group : Unspecified 2026-02-12T22:09:41.833 INFO:teuthology.orchestra.run.trial024.stdout:Size : 7963769 2026-02-12T22:09:41.833 INFO:teuthology.orchestra.run.trial024.stdout:License : GPL-3.0-or-later 2026-02-12T22:09:41.833 INFO:teuthology.orchestra.run.trial024.stdout:Signature : 2026-02-12T22:09:41.833 INFO:teuthology.orchestra.run.trial024.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:09:41.833 INFO:teuthology.orchestra.run.trial024.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:09:41.833 INFO:teuthology.orchestra.run.trial024.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:09:41.833 INFO:teuthology.orchestra.run.trial024.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:09:41.833 INFO:teuthology.orchestra.run.trial024.stdout:Packager : Release Engineering 2026-02-12T22:09:41.833 INFO:teuthology.orchestra.run.trial024.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:09:41.833 INFO:teuthology.orchestra.run.trial024.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:09:41.833 INFO:teuthology.orchestra.run.trial024.stdout:Summary : Support tools for GRUB. 2026-02-12T22:09:41.833 INFO:teuthology.orchestra.run.trial024.stdout:Description : 2026-02-12T22:09:41.834 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-12T22:09:41.834 INFO:teuthology.orchestra.run.trial024.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:09:41.834 INFO:teuthology.orchestra.run.trial024.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:09:41.834 INFO:teuthology.orchestra.run.trial024.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:09:41.834 INFO:teuthology.orchestra.run.trial024.stdout:hardware devices. 2026-02-12T22:09:41.834 INFO:teuthology.orchestra.run.trial024.stdout: 2026-02-12T22:09:41.834 INFO:teuthology.orchestra.run.trial024.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:09:41.835 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:09:41.835 INFO:teuthology.task.kernel:Updating grub on trial024 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:41.835 DEBUG:teuthology.orchestra.run.trial024:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:09:41.840 INFO:teuthology.orchestra.run.trial168.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:09:41.842 DEBUG:teuthology.orchestra.run.trial168:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:09:41.902 INFO:teuthology.orchestra.run.trial024.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:09:41.904 DEBUG:teuthology.orchestra.run.trial024:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:09:41.908 INFO:teuthology.orchestra.run.trial168.stdout:/sbin/grubby 2026-02-12T22:09:41.909 INFO:teuthology.orchestra.run.trial168.stdout:yes 2026-02-12T22:09:41.910 DEBUG:teuthology.orchestra.run.trial168:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:09:41.969 INFO:teuthology.orchestra.run.trial024.stdout:/sbin/grubby 2026-02-12T22:09:41.971 INFO:teuthology.orchestra.run.trial024.stdout:yes 2026-02-12T22:09:41.971 DEBUG:teuthology.orchestra.run.trial024:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:09:41.975 INFO:teuthology.orchestra.run.trial168.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:09:41.976 DEBUG:teuthology.orchestra.run.trial168:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:42.037 INFO:teuthology.orchestra.run.trial024.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:09:42.038 DEBUG:teuthology.orchestra.run.trial024:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:42.053 DEBUG:teuthology.orchestra.run.trial168:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:09:42.116 DEBUG:teuthology.orchestra.run.trial024:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:09:42.162 INFO:teuthology.orchestra.run.trial168.stderr:Generating grub configuration file ... 2026-02-12T22:09:42.226 INFO:teuthology.orchestra.run.trial024.stderr:Generating grub configuration file ... 2026-02-12T22:09:42.341 INFO:teuthology.orchestra.run.trial168.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:09:42.350 INFO:teuthology.orchestra.run.trial168.stderr:done 2026-02-12T22:09:42.352 DEBUG:teuthology.orchestra.run.trial168:> test -d /sys/firmware/efi 2026-02-12T22:09:42.370 DEBUG:teuthology.orchestra.run.trial168:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:09:42.404 INFO:teuthology.orchestra.run.trial024.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:09:42.413 INFO:teuthology.orchestra.run.trial024.stderr:done 2026-02-12T22:09:42.415 DEBUG:teuthology.orchestra.run.trial024:> test -d /sys/firmware/efi 2026-02-12T22:09:42.433 DEBUG:teuthology.orchestra.run.trial024:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:09:42.441 INFO:teuthology.orchestra.run.trial168.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:09:42.441 INFO:teuthology.orchestra.run.trial168.stdout:/boot/efi/EFI/rocky 2026-02-12T22:09:42.443 DEBUG:teuthology.orchestra.run.trial168:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:09:42.507 INFO:teuthology.orchestra.run.trial024.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:09:42.507 INFO:teuthology.orchestra.run.trial024.stdout:/boot/efi/EFI/rocky 2026-02-12T22:09:42.509 DEBUG:teuthology.orchestra.run.trial024:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:09:42.510 INFO:teuthology.orchestra.run.trial168.stdout:no 2026-02-12T22:09:42.511 DEBUG:teuthology.orchestra.run.trial168:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:09:42.576 INFO:teuthology.orchestra.run.trial024.stdout:no 2026-02-12T22:09:42.577 DEBUG:teuthology.orchestra.run.trial024:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:09:42.578 INFO:teuthology.orchestra.run.trial168.stdout:yes 2026-02-12T22:09:42.578 DEBUG:teuthology.orchestra.run.trial168:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:09:42.644 INFO:teuthology.orchestra.run.trial024.stdout:yes 2026-02-12T22:09:42.644 DEBUG:teuthology.orchestra.run.trial024:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:09:42.645 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial168 2026-02-12T22:09:42.646 DEBUG:teuthology.orchestra.run.trial168:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:09:42.711 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial024 2026-02-12T22:09:42.711 DEBUG:teuthology.orchestra.run.trial024:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:09:42.712 INFO:teuthology.orchestra.run.trial168.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:09:42.775 INFO:teuthology.orchestra.run.trial024.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:10:12.688 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:12.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:12.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:12.766 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:12.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:12.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:12.824 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:12.832 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:12.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:12.841 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:12.842 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:12.899 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:12.899 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:12.899 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:12.899 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:12.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:12.913 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:12.913 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:12.970 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:12.970 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:12.970 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:12.971 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:13.900 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:13.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:13.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:13.978 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:13.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:13.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:14.030 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:14.039 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:14.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:14.089 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:14.089 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:14.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:14.114 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:14.114 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:14.146 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:14.147 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:14.147 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:14.147 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:14.170 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:14.171 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:14.171 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:14.171 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:15.147 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:15.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:15.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:15.225 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:15.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:15.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:15.276 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:15.286 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:15.335 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:15.335 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:15.335 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:15.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:15.368 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:15.368 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:15.391 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:15.392 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:15.392 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:15.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:15.425 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:15.425 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:15.425 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:15.426 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:16.393 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:16.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:16.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:16.491 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:16.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:16.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:16.543 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:16.553 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:16.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:16.561 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:16.561 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:16.618 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:16.618 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:16.618 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:16.618 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:16.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:16.628 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:16.628 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:16.686 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:16.687 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:16.687 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:16.687 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:17.619 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:17.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:17.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:17.719 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:17.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:17.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:17.771 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:17.781 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:17.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:17.789 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:17.789 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:17.845 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:17.845 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:17.845 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:17.845 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:17.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:17.869 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:17.869 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:17.926 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:17.926 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:17.926 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:17.927 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:18.846 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:18.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:18.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:18.944 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:18.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:18.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:18.997 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:19.006 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:19.055 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:19.055 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:19.055 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:19.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:19.083 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:19.083 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:19.113 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:19.113 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:19.113 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:19.113 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:19.140 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:19.141 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:19.141 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:19.141 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:20.115 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:20.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:20.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:20.213 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:20.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:20.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:20.266 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:20.275 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:20.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:20.283 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:20.284 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:20.340 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:20.341 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:20.341 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:20.341 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:20.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:20.354 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:20.354 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:20.411 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:20.411 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:20.411 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:20.411 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:21.342 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:21.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:21.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:21.442 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:21.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:21.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:21.495 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:21.504 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:21.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:21.554 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:21.554 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:21.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:21.580 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:21.581 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:21.611 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:21.611 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:21.611 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:21.611 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:21.638 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:21.638 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:21.639 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:21.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:22.612 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:22.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:22.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:22.711 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:22.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:22.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:22.762 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:22.771 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:22.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:22.821 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:22.821 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:22.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:22.850 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:22.850 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:22.879 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:22.879 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:22.879 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:22.879 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:22.907 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:22.907 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:22.907 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:22.907 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:23.881 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:23.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:23.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:23.980 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:23.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:23.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:24.046 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:24.053 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:24.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:24.062 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:24.062 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:24.118 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:24.118 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:24.118 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:24.118 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:24.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:24.134 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:24.134 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:24.192 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:24.192 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:24.192 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:24.192 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:25.119 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:25.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:25.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:25.218 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:25.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:25.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:25.270 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:25.279 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:25.329 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:25.329 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:25.329 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:25.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:25.356 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:25.356 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:25.386 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:25.386 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:25.386 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:25.386 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:25.413 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:25.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:25.414 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:25.414 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:26.387 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:26.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:26.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:26.485 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:26.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:26.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:26.537 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:26.546 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:26.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:26.595 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:26.595 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:26.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:26.635 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:26.635 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:26.652 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:26.652 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:26.652 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:26.652 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:26.692 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:26.692 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:26.692 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:26.692 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:27.654 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:27.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:27.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:27.753 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:27.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:27.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:27.805 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:27.814 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:27.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:27.863 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:27.863 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:27.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:27.891 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:27.891 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:27.920 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:27.920 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:27.920 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:27.920 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:27.950 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:27.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:27.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:27.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:28.921 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:28.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:28.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:29.020 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:29.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:29.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:29.073 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:29.082 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:29.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:29.131 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:29.131 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:29.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:29.158 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:29.158 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:29.188 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:29.188 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:29.188 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:29.188 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:29.213 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:29.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:29.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:29.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:30.189 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:30.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:30.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:30.287 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:30.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:30.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:30.340 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:30.349 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:30.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:30.398 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:30.398 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:30.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:30.427 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:30.428 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:30.454 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:30.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:30.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:30.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:30.484 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:30.484 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:30.485 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:30.485 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:31.456 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:31.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:31.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:31.543 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:31.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:31.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:31.596 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:31.605 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:31.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:31.654 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:31.654 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:31.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:31.691 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:31.691 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:31.711 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:31.711 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:31.711 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:31.712 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:31.749 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:31.749 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:31.749 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:31.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:32.713 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:32.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:32.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:32.811 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:32.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:32.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:32.863 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:32.873 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:32.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:32.922 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:32.922 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:32.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:32.954 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:32.955 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:32.979 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:32.979 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:32.979 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:32.979 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:33.013 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:33.013 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:33.013 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:33.014 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:33.980 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:33.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:33.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:34.079 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:34.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:34.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:34.131 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:34.141 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:34.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:34.149 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:34.149 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:34.207 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:34.207 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:34.207 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:34.207 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:34.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:34.229 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:34.230 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:34.287 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:34.287 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:34.287 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:34.287 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:35.208 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:35.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:35.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:35.306 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:35.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:35.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:35.358 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:35.367 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:35.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:35.417 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:35.417 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:35.447 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:35.447 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:35.447 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:35.474 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:35.474 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:35.474 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:35.475 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:35.505 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:35.505 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:35.505 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:35.505 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:36.476 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:36.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:36.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:36.575 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:36.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:36.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:36.628 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:36.637 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:36.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:36.645 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:36.645 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:36.701 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:36.701 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:36.701 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:36.701 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:36.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:36.717 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:36.717 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:36.774 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:36.775 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:36.775 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:36.775 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:37.702 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:37.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:37.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:37.800 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:37.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:37.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:37.832 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:37.887 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:37.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:37.896 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:37.896 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:37.954 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:37.954 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:37.954 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:37.954 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:37.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:37.973 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:37.973 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:38.030 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:38.031 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:38.031 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:38.031 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:38.955 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:38.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:38.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:39.054 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:39.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:39.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:39.106 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:39.115 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:39.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:39.163 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:39.163 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:39.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:39.190 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:39.190 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:39.219 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:39.220 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:39.220 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:39.220 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:39.247 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:39.248 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:39.248 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:39.248 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:40.220 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:40.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:40.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:40.321 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:40.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:40.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:40.386 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:40.395 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:40.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:40.403 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:40.404 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:40.461 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:40.461 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:40.461 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:40.461 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:40.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:40.472 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:40.472 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:40.529 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:40.530 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:40.530 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:40.530 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:41.462 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:41.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:41.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:41.561 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:41.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:41.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:41.612 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:41.622 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:41.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:41.671 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:41.671 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:41.707 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:41.707 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:41.708 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:41.728 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:41.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:41.728 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:41.728 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:41.765 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:41.766 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:41.766 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:41.766 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:42.729 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:42.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:42.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:42.825 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:42.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:42.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:42.877 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:42.886 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:42.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:42.935 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:42.936 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:42.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:42.962 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:42.962 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:42.992 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:42.992 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:42.992 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:42.992 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:43.019 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:43.019 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:43.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:43.020 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:43.993 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:43.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:43.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:44.092 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:44.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:44.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:44.145 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:44.154 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:44.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:44.162 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:44.163 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:44.219 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:44.220 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:44.220 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:44.220 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:44.237 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:44.237 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:44.237 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:44.294 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:44.294 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:44.294 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:44.294 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:45.221 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:45.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:45.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:45.319 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:45.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:45.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:45.371 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:45.381 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:45.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:45.389 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:45.389 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:45.446 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:45.446 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:45.446 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:45.446 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:45.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:45.469 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:45.469 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:45.527 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:45.527 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:45.527 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:45.527 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:46.447 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:46.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:46.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:46.545 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:46.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:46.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:46.605 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:46.613 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:46.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:46.622 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:46.622 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:46.679 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:46.679 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:46.679 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:46.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:46.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:46.691 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:46.691 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:46.748 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:46.748 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:46.748 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:46.748 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:47.680 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:47.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:47.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:47.782 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:47.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:47.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:47.836 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:47.845 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:47.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:47.897 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:47.897 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:47.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:47.928 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:47.928 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:47.954 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:47.954 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:47.954 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:47.954 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:47.984 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:47.984 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:47.984 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:47.984 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:48.955 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:48.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:48.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:49.055 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:49.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:49.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:49.107 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:49.116 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:49.166 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:49.166 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:49.166 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:49.196 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:49.196 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:49.196 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:49.223 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:49.223 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:49.223 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:49.223 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:49.253 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:49.253 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:49.253 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:49.253 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:50.224 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:50.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:50.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:50.324 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:50.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:50.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:50.376 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:50.385 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:50.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:50.432 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:50.432 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:50.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:50.456 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:50.456 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:50.489 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:50.489 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:50.489 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:50.489 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:50.513 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:50.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:50.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:50.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:51.489 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:51.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:51.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:51.587 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:51.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:51.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:51.639 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:51.649 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:51.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:51.657 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:51.657 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:51.715 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:51.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:51.715 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:51.715 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:51.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:51.730 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:51.730 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:51.788 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:51.788 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:51.788 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:51.788 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:52.716 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:52.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:52.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:52.815 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:52.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:52.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:52.877 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:52.886 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:52.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:52.895 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:52.895 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:52.953 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:52.953 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:52.953 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:52.953 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:52.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:52.966 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:52.966 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:53.023 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:53.023 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:53.023 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:53.024 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:53.954 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:53.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:53.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:54.052 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:54.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:54.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:54.104 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:54.113 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:54.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:54.162 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:54.162 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:54.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:54.193 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:54.193 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:54.219 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:54.219 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:54.219 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:54.219 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:54.250 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:54.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:54.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:54.250 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:55.220 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:55.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:55.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:55.319 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:55.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:55.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:55.372 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:55.381 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:55.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:55.390 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:55.390 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:55.447 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:55.447 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:55.447 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:55.447 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:55.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:55.457 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:55.457 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:55.515 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:55.515 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:55.515 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:55.515 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:56.448 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:56.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:56.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:56.546 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:56.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:56.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:56.606 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:56.615 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:56.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:56.665 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:56.665 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:56.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:56.705 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:56.705 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:56.721 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:56.721 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:56.722 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:56.722 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:56.761 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:56.761 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:56.761 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:56.761 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:57.722 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:57.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:57.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:57.823 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:57.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:57.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:57.875 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:57.884 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:57.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:57.934 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:57.934 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:57.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:57.959 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:57.960 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:57.991 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:57.992 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:57.992 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:57.992 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:58.017 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:58.017 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:58.018 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:58.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:58.993 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:58.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:58.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:59.092 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:59.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:59.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:59.146 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:10:59.155 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:10:59.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:10:59.204 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:59.204 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:10:59.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:10:59.230 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:59.230 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:10:59.261 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:59.261 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:59.262 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:59.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:59.288 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:59.288 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:59.288 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:59.288 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:00.263 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:00.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:00.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:00.351 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:00.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:00.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:00.408 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:00.418 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:00.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:00.426 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:00.427 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:00.484 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:00.484 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:00.484 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:00.484 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:00.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:00.500 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:00.500 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:00.557 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:00.558 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:00.558 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:00.558 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:01.485 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:01.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:01.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:01.584 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:01.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:01.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:01.649 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:01.658 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:01.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:01.666 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:01.666 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:01.722 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:01.723 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:01.723 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:01.723 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:01.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:01.734 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:01.734 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:01.791 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:01.791 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:01.792 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:01.792 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:02.724 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:02.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:02.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:02.819 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:02.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:02.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:02.871 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:02.880 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:02.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:02.929 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:02.929 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:02.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:02.955 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:02.955 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:02.986 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:02.986 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:02.986 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:02.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:03.012 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:03.013 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:03.013 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:03.013 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:03.987 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:03.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:03.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:04.085 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:04.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:04.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:04.137 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:04.146 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:04.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:04.194 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:04.194 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:04.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:04.218 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:04.218 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:04.253 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:04.253 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:04.253 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:04.253 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:04.276 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:04.277 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:04.277 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:04.277 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:05.255 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:05.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:05.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:05.353 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:05.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:05.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:05.410 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:05.420 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:05.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:05.428 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:05.428 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:05.486 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:05.486 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:05.486 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:05.486 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:05.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:05.503 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:05.503 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:05.561 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:05.561 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:05.561 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:05.561 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:06.487 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:06.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:06.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:06.585 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:06.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:06.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:06.638 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:06.647 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:06.696 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:06.696 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:06.696 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:06.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:06.727 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:06.727 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:06.753 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:06.753 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:06.753 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:06.753 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:06.784 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:06.784 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:06.784 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:06.784 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:07.754 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:07.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:07.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:07.851 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:07.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:07.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:07.903 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:07.912 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:07.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:07.961 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:07.961 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:07.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:07.994 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:07.995 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:08.017 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:08.018 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:08.018 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:08.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:08.051 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:08.051 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:08.051 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:08.051 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:09.018 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:09.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:09.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:09.116 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:09.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:09.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:09.180 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:09.190 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:09.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:09.199 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:09.199 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:09.256 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:09.256 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:09.256 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:09.256 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:09.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:09.273 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:09.273 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:09.329 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:09.330 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:09.330 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:09.330 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:10.257 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:10.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:10.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:10.357 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:10.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:10.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:10.409 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:10.418 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:10.467 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:10.468 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:10.468 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:10.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:10.497 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:10.498 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:10.524 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:10.524 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:10.524 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:10.524 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:10.554 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:10.555 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:10.555 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:10.555 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:11.525 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:11.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:11.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:11.624 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:11.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:11.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:11.675 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:11.684 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:11.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:11.735 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:11.735 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:11.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:11.761 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:11.761 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:11.791 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:11.791 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:11.791 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:11.792 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:11.817 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:11.817 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:11.817 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:11.817 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:12.792 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:12.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:12.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:12.891 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:12.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:12.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:12.950 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:12.959 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:12.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:12.967 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:12.967 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:13.024 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:13.024 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:13.025 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:13.025 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:13.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:13.037 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:13.037 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:13.094 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:13.094 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:13.094 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:13.094 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:14.025 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:14.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:14.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:14.119 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:14.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:14.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:14.169 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:14.179 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:14.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:14.229 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:14.229 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:14.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:14.256 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:14.256 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:14.286 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:14.286 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:14.286 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:14.286 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:14.312 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:14.313 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:14.313 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:14.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:15.287 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:15.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:15.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:15.386 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:15.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:15.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:15.439 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:15.448 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:15.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:15.497 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:15.497 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:15.540 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:15.540 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:15.541 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:15.554 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:15.555 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:15.555 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:15.555 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:15.597 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:15.598 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:15.598 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:15.598 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:16.556 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:16.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:16.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:16.654 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:16.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:16.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:16.706 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:16.715 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:16.765 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:16.765 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:16.765 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:16.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:16.794 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:16.794 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:16.824 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:16.824 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:16.824 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:16.824 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:16.850 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:16.851 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:16.851 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:16.851 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:17.825 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:17.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:17.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:17.881 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:17.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:17.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:17.932 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:17.942 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:17.991 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:17.991 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:17.991 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:18.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:18.021 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:18.021 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:18.048 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:18.048 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:18.048 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:18.049 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:18.076 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:18.077 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:18.077 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:18.077 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:19.049 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:19.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:19.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:19.149 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:19.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:19.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:19.201 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:19.210 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:19.260 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:19.260 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:19.260 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:19.296 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:19.296 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:19.296 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:19.316 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:19.316 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:19.317 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:19.317 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:19.353 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:19.354 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:19.354 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:19.354 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:20.317 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:20.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:20.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:20.371 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:20.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:20.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:20.421 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:20.430 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:20.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:20.480 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:20.480 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:20.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:20.504 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:20.505 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:20.536 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:20.536 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:20.536 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:20.536 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:20.562 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:20.563 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:20.563 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:20.563 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:21.537 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:21.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:21.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:21.636 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:21.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:21.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:21.647 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:21.698 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:21.723 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:21.723 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:21.723 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:21.780 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:21.780 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:21.780 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:21.780 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:21.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:21.785 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:21.786 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:21.842 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:21.843 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:21.843 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:21.843 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:22.781 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:22.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:22.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:22.843 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:22.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:22.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:22.846 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:22.907 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:22.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:22.922 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:22.922 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:22.979 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:22.979 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:22.979 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:22.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:22.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:22.992 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:22.992 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:23.049 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:23.049 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:23.049 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:23.049 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:23.980 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:23.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:23.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:24.079 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:24.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:24.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:24.145 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:24.154 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:24.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:24.163 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:24.163 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:24.220 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:24.220 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:24.220 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:24.220 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:24.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:24.230 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:24.230 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:24.288 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:24.288 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:24.288 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:24.288 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:25.220 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:25.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:25.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:25.314 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:25.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:25.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:25.365 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:25.375 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:25.424 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:25.424 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:25.424 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:25.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:25.446 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:25.446 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:25.481 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:25.482 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:25.482 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:25.482 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:25.503 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:25.503 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:25.503 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:25.503 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:26.483 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:26.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:26.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:26.581 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:26.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:26.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:26.633 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:26.643 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:26.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:26.651 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:26.651 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:26.708 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:26.709 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:26.709 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:26.709 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:26.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:26.721 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:26.721 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:26.778 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:26.778 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:26.778 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:26.778 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:27.710 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:27.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:27.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:27.809 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:27.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:27.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:27.860 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:27.869 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:27.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:27.917 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:27.917 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:27.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:27.953 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:27.953 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:27.972 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:27.973 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:27.973 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:27.973 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:28.010 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:28.011 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:28.011 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:28.011 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:28.973 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:28.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:28.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:29.071 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:29.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:29.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:29.124 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:29.133 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:29.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:29.182 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:29.182 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:29.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:29.210 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:29.210 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:29.239 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:29.240 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:29.240 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:29.240 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:29.266 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:29.267 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:29.267 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:29.267 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:30.241 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:30.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:30.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:30.339 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:30.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:30.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:30.391 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:30.400 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:30.447 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:30.447 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:30.447 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:30.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:30.476 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:30.476 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:30.504 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:30.505 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:30.505 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:30.505 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:30.533 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:30.534 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:30.534 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:30.534 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:31.506 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:31.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:31.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:31.600 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:31.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:31.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:31.651 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:31.661 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:31.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:31.711 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:31.711 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:31.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:31.733 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:31.733 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:31.767 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:31.768 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:31.768 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:31.768 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:31.791 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:31.791 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:31.791 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:31.792 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:32.769 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:32.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:32.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:32.868 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:32.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:32.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:32.920 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:32.929 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:32.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:32.980 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:32.981 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:33.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:33.018 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:33.018 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:33.038 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:33.038 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:33.038 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:33.038 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:33.076 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:33.076 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:33.076 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:33.076 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:34.040 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:34.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:34.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:34.138 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:34.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:34.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:34.191 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:34.200 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:34.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:34.249 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:34.249 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:34.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:34.284 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:34.284 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:34.306 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:34.306 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:34.306 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:34.306 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:34.341 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:34.342 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:34.342 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:34.342 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:35.307 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:35.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:35.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:35.404 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:35.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:35.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:35.457 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:35.466 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:35.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:35.475 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:35.475 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:35.531 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:35.532 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:35.532 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:35.532 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:35.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:35.542 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:35.542 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:35.600 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:35.600 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:35.600 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:35.600 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:36.533 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:36.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:36.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:36.632 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:36.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:36.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:36.684 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:36.693 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:36.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:36.742 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:36.743 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:36.768 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:36.768 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:36.768 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:36.799 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:36.799 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:36.799 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:36.799 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:36.826 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:36.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:36.826 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:36.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:37.801 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:37.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:37.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:37.853 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:37.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:37.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:37.905 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:37.914 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:37.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:37.963 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:37.964 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:37.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:37.997 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:37.997 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:38.020 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:38.021 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:38.021 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:38.021 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:38.053 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:38.053 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:38.053 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:38.054 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:39.022 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:39.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:39.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:39.104 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:39.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:39.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:39.156 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:39.165 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:39.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:39.214 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:39.215 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:39.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:39.241 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:39.241 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:39.272 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:39.272 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:39.272 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:39.272 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:39.297 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:39.297 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:39.298 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:39.298 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:40.272 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:40.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:40.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:40.325 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:40.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:40.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:40.376 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:40.385 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:40.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:40.432 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:40.432 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:40.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:40.463 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:40.464 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:40.488 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:40.488 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:40.488 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:40.488 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:40.520 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:40.520 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:40.520 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:40.520 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:41.489 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:41.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:41.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:41.588 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:41.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:41.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:41.640 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:41.649 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:41.699 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:41.699 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:41.699 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:41.724 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:41.724 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:41.725 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:41.756 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:41.756 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:41.757 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:41.757 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:41.781 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:41.781 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:41.782 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:41.782 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:42.758 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:42.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:42.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:42.856 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:42.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:42.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:42.908 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:42.917 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:42.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:42.966 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:42.967 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:42.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:42.990 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:42.990 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:43.024 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:43.024 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:43.024 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:43.024 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:43.048 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:43.048 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:43.048 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:43.048 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:44.026 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:44.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:44.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:44.096 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:44.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:44.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:44.148 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:44.157 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:44.208 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:44.208 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:44.208 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:44.235 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:44.235 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:44.236 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:44.265 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:44.265 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:44.265 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:44.265 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:44.292 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:44.292 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:44.292 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:44.292 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:45.266 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:45.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:45.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:45.364 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:45.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:45.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:45.425 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:45.434 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:45.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:45.443 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:45.443 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:45.500 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:45.500 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:45.500 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:45.500 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:45.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:45.519 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:45.519 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:45.577 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:45.577 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:45.577 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:45.577 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:46.502 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:46.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:46.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:46.601 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:46.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:46.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:46.662 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:46.672 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:46.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:46.680 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:46.680 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:46.736 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:46.736 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:46.736 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:46.736 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:46.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:46.745 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:46.745 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:46.802 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:46.802 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:46.802 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:46.803 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:47.737 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:47.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:47.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:47.838 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:47.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:47.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:47.890 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:47.899 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:47.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:47.948 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:47.948 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:47.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:47.978 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:47.978 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:48.005 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:48.005 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:48.005 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:48.006 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:48.035 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:48.035 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:48.036 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:48.036 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:49.007 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:49.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:49.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:49.107 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:49.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:49.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:49.157 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:49.166 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:49.216 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:49.216 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:49.216 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:49.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:49.243 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:49.243 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:49.273 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:49.273 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:49.273 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:49.273 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:49.299 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:49.299 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:49.300 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:49.300 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:50.274 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:50.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:50.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:50.372 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:50.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:50.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:50.423 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:50.432 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:50.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:50.482 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:50.482 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:50.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:50.509 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:50.510 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:50.540 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:50.541 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:50.541 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:50.541 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:50.567 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:50.567 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:50.567 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:50.567 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:51.542 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:51.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:51.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:51.640 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:51.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:51.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:51.692 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:51.701 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:51.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:51.751 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:51.751 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:51.783 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:51.783 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:51.783 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:51.807 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:51.807 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:51.807 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:51.807 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:51.841 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:51.841 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:51.841 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:51.842 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:52.809 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:52.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:52.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:52.907 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:52.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:52.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:52.959 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:52.968 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:53.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:53.017 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:53.017 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:53.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:53.041 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:53.041 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:53.073 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:53.074 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:53.074 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:53.074 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:53.099 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:53.099 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:53.099 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:53.099 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:54.075 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:54.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:54.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:54.175 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:54.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:54.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:54.227 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:54.236 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:54.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:54.285 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:54.285 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:54.320 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:54.320 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:54.321 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:54.342 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:54.343 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:54.343 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:54.343 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:54.379 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:54.379 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:54.379 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:54.379 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:55.344 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:55.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:55.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:55.443 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:55.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:55.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:55.507 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:55.517 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:55.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:55.525 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:55.525 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:55.582 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:55.582 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:55.582 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:55.582 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:55.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:55.601 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:55.601 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:55.659 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:55.659 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:55.659 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:55.659 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:56.583 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:56.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:56.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:56.682 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:56.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:56.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:56.734 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:56.744 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:56.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:56.793 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:56.793 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:56.827 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:56.827 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:56.827 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:56.849 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:56.849 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:56.850 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:56.850 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:56.885 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:56.885 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:56.885 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:56.885 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:57.851 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:57.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:57.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:57.949 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:57.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:57.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:58.001 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:58.009 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:58.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:58.018 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:58.018 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:58.076 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:58.076 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:58.076 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:58.076 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:58.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:58.084 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:58.084 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:58.141 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:58.141 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:58.141 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:58.141 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:59.078 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:59.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:59.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:59.174 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:59.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:59.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:59.225 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:11:59.235 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:11:59.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:11:59.285 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:59.285 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:11:59.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:11:59.313 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:59.313 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:11:59.342 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:59.342 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:59.342 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:59.342 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:59.371 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:59.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:59.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:59.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:00.343 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:00.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:00.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:00.442 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:00.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:00.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:00.508 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:00.518 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:00.526 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:00.526 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:00.526 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:00.583 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:00.583 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:00.583 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:00.583 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:00.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:00.605 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:00.605 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:00.662 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:00.662 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:00.662 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:00.663 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:01.584 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:01.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:01.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:01.682 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:01.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:01.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:01.735 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:01.744 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:01.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:01.794 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:01.794 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:01.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:01.836 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:01.836 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:01.851 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:01.851 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:01.851 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:01.852 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:01.894 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:01.894 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:01.895 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:01.895 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:02.852 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:02.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:02.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:02.905 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:02.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:02.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:02.956 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:02.965 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:03.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:03.014 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:03.014 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:03.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:03.046 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:03.046 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:03.071 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:03.071 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:03.071 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:03.071 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:03.103 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:03.104 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:03.104 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:03.104 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:04.072 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:04.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:04.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:04.147 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:04.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:04.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:04.198 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:04.207 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:04.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:04.257 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:04.257 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:04.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:04.284 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:04.284 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:04.314 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:04.314 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:04.314 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:04.314 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:04.341 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:04.342 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:04.342 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:04.342 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:05.316 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:05.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:05.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:05.413 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:05.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:05.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:05.465 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:05.474 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:05.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:05.524 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:05.524 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:05.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:05.556 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:05.556 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:05.581 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:05.581 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:05.581 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:05.581 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:05.614 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:05.614 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:05.614 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:05.615 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:06.582 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:06.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:06.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:06.682 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:06.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:06.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:06.734 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:06.744 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:06.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:06.793 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:06.794 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:06.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:06.831 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:06.831 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:06.850 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:06.850 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:06.850 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:06.850 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:06.888 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:06.888 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:06.888 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:06.888 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:07.851 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:07.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:07.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:07.930 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:07.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:07.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:07.982 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:07.991 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:08.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:08.040 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:08.040 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:08.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:08.066 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:08.066 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:08.098 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:08.099 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:08.099 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:08.099 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:08.123 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:08.123 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:08.123 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:08.124 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:09.100 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:09.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:09.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:09.197 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:09.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:09.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:09.252 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:09.261 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:09.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:09.270 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:09.270 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:09.327 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:09.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:09.327 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:09.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:09.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:09.344 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:09.345 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:09.402 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:09.402 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:09.402 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:09.403 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:10.328 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:10.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:10.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:10.391 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:10.403 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:10.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:10.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:10.466 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:10.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:10.474 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:10.474 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:10.531 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:10.531 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:10.531 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:10.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:10.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:10.549 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:10.549 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:10.605 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:10.606 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:10.606 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:10.606 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:11.532 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:11.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:11.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:11.634 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:11.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:11.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:11.686 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:11.695 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:11.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:11.744 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:11.745 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:11.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:11.775 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:11.775 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:11.801 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:11.801 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:11.801 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:11.801 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:11.832 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:11.832 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:11.832 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:11.832 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:12.802 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:12.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:12.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:12.900 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:12.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:12.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:12.952 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:12.961 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:13.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:13.012 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:13.012 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:13.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:13.043 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:13.043 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:13.070 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:13.070 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:13.071 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:13.071 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:13.100 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:13.100 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:13.100 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:13.100 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:14.072 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:14.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:14.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:14.170 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:14.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:14.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:14.222 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:14.232 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:14.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:14.281 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:14.281 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:14.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:14.313 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:14.313 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:14.338 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:14.338 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:14.338 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:14.338 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:14.371 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:14.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:14.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:14.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:15.340 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:15.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:15.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:15.439 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:15.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:15.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:15.491 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:15.500 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:15.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:15.550 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:15.551 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:15.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:15.590 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:15.590 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:15.607 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:15.607 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:15.608 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:15.608 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:15.648 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:15.648 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:15.648 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:15.648 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:16.609 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:16.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:16.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:16.662 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:16.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:16.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:16.714 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:16.725 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:16.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:16.735 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:16.735 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:16.795 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:16.796 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:16.796 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:16.796 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:16.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:16.803 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:16.803 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:16.860 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:16.860 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:16.860 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:16.860 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:17.796 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:17.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:17.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:17.896 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:17.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:17.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:17.949 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:17.958 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:18.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:18.007 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:18.008 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:18.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:18.040 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:18.040 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:18.064 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:18.065 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:18.065 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:18.065 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:18.096 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:18.097 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:18.097 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:18.097 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:19.065 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:19.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:19.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:19.163 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:19.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:19.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:19.215 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:19.224 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:19.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:19.273 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:19.273 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:19.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:19.314 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:19.314 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:19.330 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:19.330 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:19.330 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:19.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:19.371 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:19.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:19.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:19.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:20.332 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:20.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:20.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:20.430 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:20.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:20.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:20.482 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:20.491 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:20.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:20.538 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:20.538 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:20.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:20.564 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:20.565 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:20.595 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:20.596 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:20.596 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:20.596 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:20.622 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:20.622 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:20.623 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:20.623 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:21.597 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:21.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:21.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:21.692 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:21.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:21.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:21.752 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:21.762 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:21.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:21.770 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:21.770 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:21.826 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:21.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:21.826 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:21.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:21.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:21.838 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:21.838 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:21.895 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:21.895 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:21.896 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:21.896 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:22.827 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:22.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:22.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:22.925 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:22.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:22.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:22.986 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:22.995 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:23.005 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:23.005 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:23.005 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:23.062 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:23.062 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:23.062 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:23.062 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:23.070 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:23.070 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:23.070 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:23.129 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:23.129 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:23.129 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:23.129 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:24.063 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:24.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:24.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:24.162 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:24.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:24.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:24.214 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:24.223 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:24.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:24.273 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:24.273 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:24.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:24.297 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:24.298 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:24.331 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:24.331 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:24.331 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:24.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:24.355 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:24.356 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:24.356 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:24.356 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:25.332 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:25.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:25.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:25.430 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:25.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:25.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:25.483 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:25.492 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:25.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:25.542 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:25.542 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:25.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:25.578 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:25.578 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:25.598 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:25.598 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:25.598 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:25.598 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:25.634 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:25.634 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:25.634 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:25.634 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:26.599 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:26.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:26.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:26.699 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:26.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:26.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:26.750 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:26.759 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:26.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:26.808 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:26.809 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:26.843 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:26.843 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:26.843 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:26.865 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:26.865 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:26.865 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:26.865 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:26.899 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:26.899 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:26.899 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:26.899 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:27.866 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:27.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:27.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:27.963 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:27.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:27.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:28.024 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:28.033 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:28.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:28.041 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:28.041 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:28.098 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:28.099 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:28.099 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:28.099 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:28.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:28.115 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:28.115 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:28.172 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:28.173 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:28.173 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:28.173 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:29.100 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:29.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:29.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:29.199 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:29.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:29.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:29.259 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:29.269 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:29.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:29.277 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:29.277 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:29.334 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:29.334 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:29.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:29.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:29.342 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:29.342 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:29.342 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:29.399 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:29.399 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:29.399 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:29.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:30.335 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:30.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:30.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:30.433 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:30.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:30.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:30.484 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:30.493 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:30.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:30.543 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:30.543 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:30.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:30.571 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:30.571 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:30.600 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:30.600 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:30.601 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:30.601 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:30.629 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:30.629 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:30.629 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:30.629 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:31.601 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:31.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:31.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:31.700 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:31.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:31.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:31.753 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:31.762 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:31.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:31.813 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:31.813 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:31.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:31.849 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:31.850 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:31.870 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:31.870 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:31.870 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:31.870 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:31.909 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:31.909 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:31.909 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:31.909 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:32.871 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:32.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:32.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:32.971 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:32.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:32.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:33.023 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:33.032 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:33.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:33.082 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:33.083 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:33.111 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:33.111 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:33.111 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:33.140 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:33.140 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:33.140 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:33.140 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:33.169 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:33.169 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:33.169 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:33.169 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:34.140 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:34.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:34.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:34.239 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:34.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:34.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:34.291 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:34.300 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:34.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:34.349 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:34.349 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:34.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:34.377 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:34.377 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:34.406 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:34.406 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:34.406 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:34.406 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:34.434 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:34.434 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:34.434 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:34.434 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:35.407 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:35.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:35.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:35.506 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:35.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:35.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:35.557 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:35.567 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:35.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:35.616 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:35.616 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:35.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:35.657 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:35.658 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:35.673 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:35.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:35.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:35.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:35.715 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:35.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:35.716 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:35.716 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:36.675 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:36.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:36.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:36.728 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:36.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:36.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:36.780 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:36.789 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:36.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:36.840 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:36.840 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:36.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:36.872 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:36.872 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:36.897 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:36.897 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:36.897 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:36.897 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:36.928 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:36.929 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:36.929 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:36.929 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:37.898 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:37.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:37.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:37.998 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:37.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:37.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:38.049 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:38.059 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:38.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:38.109 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:38.109 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:38.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:38.144 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:38.144 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:38.166 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:38.166 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:38.166 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:38.166 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:38.201 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:38.201 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:38.201 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:38.201 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:39.168 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:39.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:39.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:39.256 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:39.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:39.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:39.307 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:39.316 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:39.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:39.366 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:39.366 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:39.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:39.403 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:39.403 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:39.423 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:39.423 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:39.423 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:39.423 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:39.460 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:39.460 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:39.461 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:39.461 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:40.425 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:40.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:40.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:40.522 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:40.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:40.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:40.584 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:40.593 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:40.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:40.601 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:40.601 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:40.658 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:40.658 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:40.658 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:40.658 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:40.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:40.667 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:40.667 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:40.723 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:40.724 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:40.724 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:40.724 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:41.659 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:41.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:41.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:41.759 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:41.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:41.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:41.811 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:41.821 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:41.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:41.870 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:41.870 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:41.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:41.907 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:41.907 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:41.927 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:41.927 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:41.927 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:41.927 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:41.964 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:41.965 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:41.965 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:41.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:42.928 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:42.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:42.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:43.027 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:43.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:43.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:43.078 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:43.088 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:43.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:43.137 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:43.137 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:43.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:43.168 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:43.168 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:43.194 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:43.194 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:43.194 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:43.194 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:43.225 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:43.225 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:43.225 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:43.225 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:44.195 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:44.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:44.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:44.293 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:44.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:44.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:44.345 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:44.354 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:44.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:44.404 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:44.405 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:44.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:44.438 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:44.438 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:44.461 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:44.461 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:44.461 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:44.461 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:44.495 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:44.495 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:44.495 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:44.495 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:45.462 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:45.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:45.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:45.561 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:45.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:45.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:45.625 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:45.634 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:45.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:45.642 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:45.642 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:45.699 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:45.699 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:45.699 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:45.699 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:45.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:45.712 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:45.712 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:45.770 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:45.770 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:45.770 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:45.771 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:46.700 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:46.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:46.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:46.799 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:46.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:46.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:46.851 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:46.860 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:46.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:46.910 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:46.910 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:46.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:46.950 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:46.950 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:46.967 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:46.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:46.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:46.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:47.007 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:47.007 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:47.007 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:47.007 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:47.968 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:47.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:47.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:48.066 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:48.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:48.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:48.118 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:48.127 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:48.176 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:48.176 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:48.177 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:48.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:48.215 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:48.215 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:48.232 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:48.232 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:48.232 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:48.233 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:48.272 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:48.273 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:48.273 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:48.273 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:49.233 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:49.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:49.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:49.331 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:49.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:49.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:49.383 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:49.392 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:49.401 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:49.401 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:49.401 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:49.459 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:49.459 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:49.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:49.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:49.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:49.475 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:49.475 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:49.532 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:49.532 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:49.532 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:49.532 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:50.460 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:50.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:50.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:50.558 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:50.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:50.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:50.610 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:50.619 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:50.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:50.669 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:50.669 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:50.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:50.710 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:50.711 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:50.726 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:50.726 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:50.726 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:50.726 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:50.768 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:50.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:50.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:50.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:51.726 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:51.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:51.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:51.823 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:51.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:51.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:51.876 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:51.885 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:51.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:51.934 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:51.935 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:51.964 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:51.964 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:51.964 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:51.991 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:51.991 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:51.991 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:51.991 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:52.021 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:52.021 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:52.021 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:52.021 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:52.991 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:52.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:52.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:53.090 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:53.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:53.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:53.142 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:53.151 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:53.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:53.202 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:53.202 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:53.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:53.229 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:53.229 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:53.259 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:53.259 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:53.259 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:53.259 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:53.286 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:53.286 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:53.286 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:53.286 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:54.260 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:54.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:54.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:54.358 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:54.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:54.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:54.411 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:54.420 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:54.429 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:54.429 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:54.430 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:54.487 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:54.487 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:54.487 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:54.487 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:54.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:54.493 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:54.493 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:54.550 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:54.551 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:54.551 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:54.551 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:55.488 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:55.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:55.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:55.587 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:55.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:55.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:55.640 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:55.650 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:55.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:55.658 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:55.658 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:55.715 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:55.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:55.715 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:55.715 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:55.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:55.733 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:55.734 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:55.791 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:55.791 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:55.792 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:55.792 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:56.716 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:56.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:56.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:56.794 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:56.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:56.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:56.845 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:56.854 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:56.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:56.904 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:56.904 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:56.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:56.934 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:56.934 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:56.961 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:56.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:56.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:56.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:56.991 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:56.991 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:56.991 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:56.991 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:57.962 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:57.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:57.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:58.021 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:58.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:58.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:58.072 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:58.082 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:58.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:58.130 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:58.130 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:58.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:58.159 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:58.159 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:58.187 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:58.187 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:58.187 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:58.187 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:58.215 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:58.215 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:58.215 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:58.215 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:59.187 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:59.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:59.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:59.287 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:59.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:59.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:59.339 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:12:59.348 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:12:59.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:12:59.398 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:59.398 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:12:59.424 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:12:59.425 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:59.425 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:12:59.454 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:59.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:59.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:59.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:59.482 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:59.483 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:59.483 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:59.483 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:00.456 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:00.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:00.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:00.511 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:00.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:00.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:00.563 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:00.572 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:00.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:00.623 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:00.623 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:00.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:00.649 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:00.649 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:00.679 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:00.680 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:00.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:00.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:00.706 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:00.707 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:00.707 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:00.707 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:01.681 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:01.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:01.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:01.732 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:01.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:01.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:01.783 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:01.793 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:01.844 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:01.844 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:01.844 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:01.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:01.873 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:01.873 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:01.901 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:01.901 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:01.901 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:01.901 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:01.930 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:01.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:01.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:01.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:02.903 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:02.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:02.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:02.991 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:02.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:02.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:03.052 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:03.061 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:03.070 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:03.070 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:03.070 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:03.128 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:03.128 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:03.128 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:03.128 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:03.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:03.141 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:03.142 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:03.198 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:03.199 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:03.199 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:03.199 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:04.129 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:04.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:04.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:04.228 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:04.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:04.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:04.279 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:04.289 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:04.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:04.339 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:04.339 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:04.371 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:04.372 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:04.372 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:04.396 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:04.397 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:04.397 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:04.397 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:04.429 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:04.430 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:04.430 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:04.430 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:05.397 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:05.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:05.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:05.494 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:05.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:05.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:05.546 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:05.555 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:05.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:05.606 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:05.606 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:05.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:05.631 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:05.632 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:05.661 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:05.661 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:05.661 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:05.661 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:05.689 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:05.689 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:05.689 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:05.689 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:06.662 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:06.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:06.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:06.714 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:06.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:06.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:06.766 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:06.775 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:06.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:06.825 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:06.825 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:06.855 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:06.855 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:06.855 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:06.882 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:06.882 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:06.882 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:06.882 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:06.912 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:06.912 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:06.912 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:06.912 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:07.883 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:07.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:07.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:07.982 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:07.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:07.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:08.034 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:08.044 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:08.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:08.094 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:08.094 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:08.119 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:08.119 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:08.120 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:08.152 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:08.152 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:08.152 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:08.152 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:08.176 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:08.176 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:08.177 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:08.177 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:09.153 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:09.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:09.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:09.252 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:09.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:09.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:09.304 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:09.313 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:09.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:09.362 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:09.362 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:09.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:09.389 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:09.389 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:09.419 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:09.419 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:09.419 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:09.419 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:09.446 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:09.446 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:09.446 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:09.446 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:10.420 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:10.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:10.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:10.518 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:10.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:10.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:10.570 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:10.579 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:10.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:10.628 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:10.628 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:10.661 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:10.661 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:10.661 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:10.686 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:10.687 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:10.687 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:10.687 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:10.718 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:10.718 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:10.718 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:10.718 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:11.688 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:11.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:11.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:11.786 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:11.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:11.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:11.838 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:11.847 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:11.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:11.897 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:11.897 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:11.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:11.929 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:11.929 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:11.955 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:11.955 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:11.955 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:11.955 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:11.986 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:11.986 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:11.986 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:11.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:12.956 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:12.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:12.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:13.054 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:13.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:13.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:13.106 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:13.116 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:13.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:13.164 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:13.164 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:13.207 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:13.207 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:13.207 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:13.221 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:13.221 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:13.221 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:13.221 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:13.264 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:13.264 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:13.264 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:13.264 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:14.222 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:14.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:14.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:14.278 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:14.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:14.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:14.329 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:14.339 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:14.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:14.387 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:14.387 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:14.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:14.413 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:14.413 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:14.444 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:14.444 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:14.444 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:14.444 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:14.470 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:14.470 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:14.471 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:14.471 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:15.445 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:15.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:15.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:15.543 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:15.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:15.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:15.604 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:15.613 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:15.621 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:15.621 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:15.621 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:15.678 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:15.679 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:15.679 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:15.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:15.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:15.697 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:15.697 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:15.755 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:15.755 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:15.756 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:15.756 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:16.680 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:16.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:16.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:16.778 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:16.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:16.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:16.831 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:16.840 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:16.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:16.890 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:16.890 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:16.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:16.924 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:16.924 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:16.947 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:16.947 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:16.947 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:16.947 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:16.980 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:16.980 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:16.980 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:16.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:17.948 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:17.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:17.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:18.048 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:18.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:18.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:18.101 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:18.110 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:18.160 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:18.161 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:18.161 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:18.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:18.185 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:18.185 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:18.218 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:18.218 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:18.218 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:18.219 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:18.242 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:18.243 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:18.243 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:18.243 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:19.219 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:19.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:19.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:19.320 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:19.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:19.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:19.387 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:19.396 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:19.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:19.406 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:19.406 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:19.463 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:19.463 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:19.463 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:19.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:19.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:19.476 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:19.476 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:19.533 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:19.533 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:19.533 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:19.533 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:20.464 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:20.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:20.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:20.562 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:20.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:20.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:20.622 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:20.632 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:20.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:20.640 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:20.640 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:20.697 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:20.697 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:20.697 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:20.697 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:20.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:20.717 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:20.717 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:20.774 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:20.774 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:20.775 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:20.775 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:21.698 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:21.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:21.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:21.776 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:21.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:21.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:21.779 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:21.838 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:21.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:21.860 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:21.861 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:21.917 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:21.917 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:21.917 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:21.917 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:21.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:21.920 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:21.920 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:21.977 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:21.977 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:21.977 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:21.977 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:22.919 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:22.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:22.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:23.017 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:23.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:23.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:23.069 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:23.078 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:23.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:23.127 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:23.127 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:23.166 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:23.166 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:23.166 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:23.184 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:23.184 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:23.184 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:23.184 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:23.223 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:23.224 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:23.224 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:23.224 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:24.184 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:24.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:24.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:24.278 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:24.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:24.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:24.330 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:24.339 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:24.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:24.390 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:24.390 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:24.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:24.431 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:24.431 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:24.448 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:24.448 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:24.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:24.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:24.488 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:24.488 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:24.488 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:24.488 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:25.449 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:25.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:25.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:25.531 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:25.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:25.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:25.583 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:25.592 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:25.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:25.642 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:25.642 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:25.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:25.674 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:25.674 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:25.698 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:25.698 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:25.698 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:25.698 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:25.732 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:25.733 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:25.733 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:25.733 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:26.698 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:26.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:26.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:26.797 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:26.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:26.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:26.849 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:26.859 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:26.867 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:26.867 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:26.867 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:26.924 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:26.924 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:26.924 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:26.924 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:26.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:26.934 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:26.934 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:26.991 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:26.991 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:26.991 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:26.991 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:27.924 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:27.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:27.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:28.023 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:28.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:28.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:28.080 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:28.089 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:28.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:28.098 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:28.098 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:28.154 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:28.154 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:28.155 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:28.155 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:28.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:28.170 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:28.170 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:28.227 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:28.227 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:28.227 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:28.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:29.155 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:29.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:29.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:29.254 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:29.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:29.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:29.306 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:29.315 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:29.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:29.363 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:29.363 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:29.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:29.398 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:29.398 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:29.420 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:29.420 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:29.420 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:29.420 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:29.456 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:29.456 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:29.456 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:29.457 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:30.421 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:30.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:30.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:30.520 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:30.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:30.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:30.572 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:30.581 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:30.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:30.589 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:30.589 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:30.646 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:30.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:30.646 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:30.647 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:30.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:30.671 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:30.671 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:30.729 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:30.729 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:30.729 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:30.730 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:31.648 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:31.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:31.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:31.709 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:31.731 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:31.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:31.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:31.795 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:31.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:31.802 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:31.802 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:31.860 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:31.860 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:31.860 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:31.860 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:31.879 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:31.879 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:31.879 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:31.938 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:31.938 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:31.938 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:31.938 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:32.861 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:32.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:32.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:32.939 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:32.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:32.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:32.942 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:33.002 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:33.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:33.015 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:33.015 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:33.072 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:33.072 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:33.072 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:33.072 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:33.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:33.093 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:33.093 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:33.151 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:33.151 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:33.151 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:33.151 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:34.073 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:34.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:34.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:34.172 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:34.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:34.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:34.229 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:34.238 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:34.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:34.247 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:34.247 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:34.304 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:34.304 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:34.304 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:34.304 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:34.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:34.318 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:34.318 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:34.375 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:34.375 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:34.375 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:34.375 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:35.305 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:35.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:35.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:35.404 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:35.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:35.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:35.464 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:35.473 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:35.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:35.482 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:35.482 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:35.540 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:35.540 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:35.540 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:35.540 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:35.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:35.549 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:35.550 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:35.607 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:35.607 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:35.607 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:35.607 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:36.541 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:36.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:36.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:36.640 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:36.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:36.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:36.692 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:36.701 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:36.750 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:36.750 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:36.750 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:36.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:36.776 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:36.776 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:36.807 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:36.807 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:36.808 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:36.808 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:36.834 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:36.834 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:36.834 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:36.834 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:37.809 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:37.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:37.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:37.860 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:37.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:37.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:37.911 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:37.920 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:37.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:37.967 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:37.968 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:37.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:37.998 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:37.998 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:38.024 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:38.024 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:38.024 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:38.024 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:38.054 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:38.055 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:38.055 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:38.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:39.025 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:39.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:39.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:39.076 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:39.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:39.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:39.128 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:39.138 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:39.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:39.185 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:39.185 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:39.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:39.212 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:39.212 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:39.242 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:39.242 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:39.242 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:39.242 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:39.269 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:39.270 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:39.270 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:39.270 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:40.243 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:40.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:40.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:40.295 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:40.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:40.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:40.347 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:40.357 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:40.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:40.406 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:40.406 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:40.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:40.433 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:40.433 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:40.461 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:40.461 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:40.462 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:40.462 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:40.490 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:40.490 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:40.490 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:40.490 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:41.463 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:41.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:41.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:41.527 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:41.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:41.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:41.579 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:41.589 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:41.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:41.637 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:41.637 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:41.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:41.677 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:41.678 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:41.694 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:41.694 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:41.694 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:41.694 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:41.734 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:41.734 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:41.734 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:41.734 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:42.695 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:42.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:42.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:42.794 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:42.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:42.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:42.847 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:42.856 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:42.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:42.904 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:42.905 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:42.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:42.932 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:42.932 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:42.961 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:42.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:42.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:42.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:42.989 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:42.989 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:42.989 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:42.989 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:43.962 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:43.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:43.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:44.061 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:44.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:44.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:44.116 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:44.126 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:44.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:44.177 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:44.177 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:44.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:44.211 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:44.211 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:44.233 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:44.234 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:44.234 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:44.234 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:44.268 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:44.268 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:44.268 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:44.268 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:45.235 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:45.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:45.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:45.333 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:45.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:45.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:45.385 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:45.394 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:45.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:45.441 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:45.441 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:45.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:45.471 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:45.471 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:45.498 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:45.498 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:45.499 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:45.499 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:45.528 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:45.528 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:45.528 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:45.529 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:46.499 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:46.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:46.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:46.598 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:46.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:46.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:46.651 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:46.660 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:46.708 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:46.708 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:46.708 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:46.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:46.744 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:46.745 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:46.765 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:46.765 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:46.766 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:46.766 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:46.801 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:46.802 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:46.802 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:46.802 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:47.767 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:47.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:47.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:47.865 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:47.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:47.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:47.917 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:47.926 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:47.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:47.976 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:47.976 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:48.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:48.000 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:48.001 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:48.033 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:48.033 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:48.033 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:48.033 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:48.057 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:48.057 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:48.057 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:48.057 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:49.034 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:49.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:49.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:49.156 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:49.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:49.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:49.209 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:49.218 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:49.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:49.227 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:49.227 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:49.283 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:49.283 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:49.283 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:49.283 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:49.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:49.295 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:49.295 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:49.352 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:49.352 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:49.352 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:49.352 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:50.284 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:50.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:50.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:50.382 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:50.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:50.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:50.434 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:50.443 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:50.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:50.493 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:50.493 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:50.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:50.530 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:50.530 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:50.549 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:50.549 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:50.549 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:50.549 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:50.587 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:50.587 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:50.587 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:50.587 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:51.551 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:51.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:51.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:51.649 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:51.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:51.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:51.701 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:51.710 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:51.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:51.759 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:51.759 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:51.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:51.792 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:51.792 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:51.816 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:51.817 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:51.817 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:51.817 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:51.849 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:51.850 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:51.850 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:51.850 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:52.819 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:52.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:52.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:52.917 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:52.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:52.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:52.979 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:52.987 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:52.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:52.995 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:52.995 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:53.052 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:53.052 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:53.052 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:53.052 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:53.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:53.066 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:53.066 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:53.124 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:53.124 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:53.124 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:53.124 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:54.053 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:54.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:54.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:54.120 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:54.126 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:54.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:54.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:54.186 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:54.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:54.201 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:54.201 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:54.257 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:54.257 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:54.257 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:54.257 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:54.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:54.258 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:54.258 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:54.315 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:54.315 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:54.316 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:54.316 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:55.258 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:55.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:55.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:55.317 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:55.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:55.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:55.321 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:55.377 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:55.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:55.403 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:55.403 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:55.453 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:55.453 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:55.453 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:55.460 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:55.460 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:55.460 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:55.460 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:55.509 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:55.509 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:55.509 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:55.509 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:56.460 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:56.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:56.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:56.556 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:56.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:56.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:56.608 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:56.617 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:56.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:56.666 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:56.666 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:56.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:56.693 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:56.693 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:56.723 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:56.723 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:56.723 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:56.723 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:56.752 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:56.752 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:56.752 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:56.752 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:57.723 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:57.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:57.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:57.776 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:57.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:57.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:57.827 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:57.836 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:57.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:57.886 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:57.886 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:57.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:57.910 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:57.910 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:57.943 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:57.943 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:57.943 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:57.943 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:57.967 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:57.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:57.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:57.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:58.943 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:58.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:58.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:59.042 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:59.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:59.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:59.092 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:13:59.101 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:13:59.150 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:13:59.150 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:59.150 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:13:59.179 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:13:59.179 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:59.179 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:13:59.207 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:59.207 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:59.207 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:59.207 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:59.237 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:59.237 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:59.237 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:59.237 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:00.208 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:00.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:00.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:00.266 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:00.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:00.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:00.318 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:00.327 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:00.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:00.377 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:00.377 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:00.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:00.400 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:00.400 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:00.434 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:00.434 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:00.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:00.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:00.457 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:00.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:00.458 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:00.458 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:01.435 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:01.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:01.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:01.535 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:01.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:01.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:01.587 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:01.596 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:01.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:01.645 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:01.645 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:01.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:01.670 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:01.670 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:01.702 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:01.702 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:01.702 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:01.702 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:01.727 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:01.727 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:01.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:01.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:02.703 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:02.704 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:02.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:02.802 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:02.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:02.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:02.855 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:02.864 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:02.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:02.914 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:02.914 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:02.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:02.946 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:02.946 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:02.970 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:02.970 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:02.970 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:02.970 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:03.002 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:03.002 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:03.003 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:03.003 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:03.971 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:03.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:03.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:04.069 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:04.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:04.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:04.121 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:04.130 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:04.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:04.180 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:04.180 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:04.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:04.204 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:04.205 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:04.237 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:04.237 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:04.238 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:04.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:04.261 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:04.262 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:04.262 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:04.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:05.238 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:05.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:05.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:05.336 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:05.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:05.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:05.388 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:05.397 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:05.447 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:05.447 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:05.447 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:05.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:05.485 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:05.486 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:05.504 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:05.504 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:05.504 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:05.504 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:05.542 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:05.542 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:05.542 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:05.542 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:06.505 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:06.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:06.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:06.556 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:06.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:06.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:06.608 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:06.617 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:06.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:06.666 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:06.666 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:06.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:06.694 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:06.694 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:06.722 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:06.722 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:06.722 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:06.722 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:06.752 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:06.752 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:06.753 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:06.753 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:07.723 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:07.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:07.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:07.776 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:07.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:07.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:07.828 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:07.837 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:07.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:07.886 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:07.886 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:07.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:07.918 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:07.918 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:07.944 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:07.944 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:07.944 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:07.944 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:07.975 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:07.975 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:07.975 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:07.976 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:08.945 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:08.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:08.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:09.043 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:09.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:09.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:09.096 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:09.105 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:09.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:09.155 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:09.155 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:09.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:09.185 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:09.185 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:09.211 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:09.212 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:09.212 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:09.212 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:09.243 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:09.243 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:09.243 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:09.243 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:10.213 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:10.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:10.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:10.264 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:10.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:10.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:10.315 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:10.324 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:10.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:10.374 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:10.374 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:10.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:10.400 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:10.400 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:10.430 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:10.430 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:10.430 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:10.430 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:10.458 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:10.459 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:10.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:10.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:11.431 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:11.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:11.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:11.530 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:11.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:11.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:11.584 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:11.593 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:11.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:11.602 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:11.602 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:11.659 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:11.659 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:11.659 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:11.659 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:11.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:11.666 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:11.666 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:11.723 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:11.723 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:11.723 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:11.723 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:12.660 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:12.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:12.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:12.758 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:12.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:12.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:12.810 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:12.819 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:12.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:12.868 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:12.869 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:12.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:12.908 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:12.908 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:12.925 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:12.925 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:12.925 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:12.925 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:12.964 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:12.964 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:12.964 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:12.964 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:13.926 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:13.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:13.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:14.024 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:14.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:14.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:14.076 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:14.086 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:14.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:14.134 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:14.134 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:14.150 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:14.150 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:14.150 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:14.191 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:14.192 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:14.192 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:14.192 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:14.209 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:14.209 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:14.209 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:14.209 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:15.192 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:15.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:15.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:15.292 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:15.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:15.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:15.344 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:15.353 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:15.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:15.403 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:15.403 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:15.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:15.437 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:15.437 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:15.459 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:15.459 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:15.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:15.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:15.493 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:15.494 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:15.494 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:15.494 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:16.460 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:16.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:16.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:16.562 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:16.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:16.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:16.614 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:16.623 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:16.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:16.673 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:16.673 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:16.708 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:16.708 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:16.708 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:16.730 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:16.730 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:16.730 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:16.731 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:16.766 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:16.766 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:16.767 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:16.767 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:17.731 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:17.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:17.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:17.832 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:17.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:17.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:17.886 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:17.895 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:17.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:17.904 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:17.904 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:17.961 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:17.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:17.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:17.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:17.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:17.977 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:17.977 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:18.035 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:18.035 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:18.036 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:18.036 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:18.962 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:18.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:18.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:19.037 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:19.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:19.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:19.039 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:19.100 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:19.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:19.118 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:19.118 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:19.175 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:19.175 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:19.175 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:19.175 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:19.176 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:19.176 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:19.176 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:19.233 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:19.233 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:19.233 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:19.233 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:20.176 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:20.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:20.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:20.273 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:20.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:20.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:20.326 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:20.335 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:20.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:20.344 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:20.344 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:20.400 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:20.401 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:20.401 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:20.401 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:20.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:20.412 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:20.412 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:20.469 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:20.470 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:20.470 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:20.470 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:21.401 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:21.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:21.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:21.470 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:21.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:21.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:21.526 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:21.535 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:21.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:21.544 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:21.544 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:21.602 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:21.602 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:21.602 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:21.602 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:21.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:21.615 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:21.615 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:21.673 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:21.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:21.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:21.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:22.603 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:22.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:22.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:22.670 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:22.675 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:22.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:22.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:22.737 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:22.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:22.747 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:22.747 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:22.804 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:22.805 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:22.805 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:22.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:22.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:22.814 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:22.814 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:22.871 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:22.871 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:22.872 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:22.872 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:23.806 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:23.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:23.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:23.905 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:23.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:23.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:23.957 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:23.966 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:24.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:24.015 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:24.016 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:24.048 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:24.048 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:24.048 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:24.072 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:24.073 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:24.073 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:24.073 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:24.105 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:24.106 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:24.106 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:24.106 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:25.073 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:25.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:25.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:25.172 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:25.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:25.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:25.224 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:25.233 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:25.242 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:25.242 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:25.242 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:25.299 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:25.299 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:25.299 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:25.299 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:25.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:25.312 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:25.312 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:25.369 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:25.370 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:25.370 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:25.370 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:26.300 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:26.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:26.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:26.398 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:26.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:26.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:26.450 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:26.459 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:26.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:26.508 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:26.508 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:26.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:26.535 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:26.535 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:26.565 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:26.566 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:26.566 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:26.566 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:26.591 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:26.591 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:26.591 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:26.591 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:27.567 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:27.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:27.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:27.634 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:27.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:27.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:27.686 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:27.695 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:27.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:27.745 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:27.745 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:27.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:27.771 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:27.771 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:27.803 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:27.803 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:27.803 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:27.803 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:27.829 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:27.829 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:27.829 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:27.830 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:28.804 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:28.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:28.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:28.859 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:28.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:28.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:28.910 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:28.920 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:28.969 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:28.969 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:28.969 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:28.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:28.994 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:28.994 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:29.025 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:29.026 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:29.026 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:29.026 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:29.050 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:29.050 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:29.050 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:29.050 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:30.026 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:30.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:30.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:30.126 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:30.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:30.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:30.187 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:30.197 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:30.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:30.205 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:30.205 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:30.262 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:30.262 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:30.262 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:30.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:30.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:30.273 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:30.273 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:30.331 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:30.331 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:30.332 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:30.332 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:31.263 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:31.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:31.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:31.361 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:31.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:31.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:31.412 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:31.422 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:31.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:31.471 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:31.471 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:31.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:31.496 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:31.496 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:31.529 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:31.529 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:31.529 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:31.529 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:31.552 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:31.552 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:31.552 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:31.552 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:32.531 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:32.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:32.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:32.629 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:32.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:32.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:32.681 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:32.690 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:32.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:32.740 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:32.740 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:32.769 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:32.769 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:32.769 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:32.797 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:32.798 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:32.798 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:32.798 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:32.826 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:32.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:32.826 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:32.827 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:33.799 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:33.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:33.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:33.890 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:33.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:33.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:33.944 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:33.953 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:34.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:34.002 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:34.003 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:34.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:34.024 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:34.024 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:34.059 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:34.059 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:34.059 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:34.059 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:34.080 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:34.080 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:34.080 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:34.080 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:35.060 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:35.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:35.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:35.158 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:35.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:35.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:35.210 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:35.219 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:35.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:35.268 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:35.268 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:35.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:35.291 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:35.291 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:35.324 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:35.325 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:35.325 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:35.325 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:35.348 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:35.348 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:35.349 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:35.349 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:36.326 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:36.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:36.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:36.423 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:36.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:36.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:36.475 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:36.485 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:36.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:36.534 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:36.534 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:36.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:36.560 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:36.560 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:36.594 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:36.594 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:36.594 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:36.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:36.618 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:36.618 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:36.618 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:36.618 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:37.595 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:37.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:37.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:37.695 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:37.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:37.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:37.747 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:37.756 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:37.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:37.805 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:37.805 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:37.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:37.831 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:37.831 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:37.862 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:37.863 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:37.863 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:37.863 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:37.889 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:37.889 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:37.889 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:37.889 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:38.864 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:38.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:38.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:38.919 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:38.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:38.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:38.971 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:38.980 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:39.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:39.030 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:39.030 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:39.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:39.059 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:39.059 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:39.088 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:39.089 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:39.089 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:39.089 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:39.116 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:39.117 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:39.117 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:39.117 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:40.090 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:40.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:40.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:40.189 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:40.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:40.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:40.241 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:40.250 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:40.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:40.300 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:40.300 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:40.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:40.323 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:40.323 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:40.358 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:40.358 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:40.358 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:40.359 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:40.382 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:40.382 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:40.382 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:40.382 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:41.360 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:41.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:41.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:41.457 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:41.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:41.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:41.508 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:41.517 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:41.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:41.567 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:41.567 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:41.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:41.598 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:41.598 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:41.624 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:41.624 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:41.624 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:41.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:41.654 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:41.655 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:41.655 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:41.655 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:42.625 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:42.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:42.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:42.723 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:42.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:42.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:42.776 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:42.785 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:42.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:42.835 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:42.835 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:42.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:42.861 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:42.861 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:42.892 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:42.892 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:42.892 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:42.892 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:42.917 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:42.917 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:42.917 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:42.917 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:43.892 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:43.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:43.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:43.990 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:43.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:43.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:44.042 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:44.051 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:44.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:44.102 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:44.102 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:44.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:44.128 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:44.128 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:44.159 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:44.159 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:44.159 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:44.159 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:44.185 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:44.185 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:44.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:44.186 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:45.160 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:45.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:45.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:45.247 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:45.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:45.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:45.299 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:45.308 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:45.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:45.355 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:45.356 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:45.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:45.394 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:45.394 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:45.412 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:45.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:45.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:45.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:45.452 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:45.452 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:45.453 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:45.453 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:46.414 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:46.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:46.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:46.475 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:46.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:46.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:46.527 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:46.537 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:46.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:46.587 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:46.587 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:46.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:46.625 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:46.625 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:46.644 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:46.644 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.644 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:46.644 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:46.683 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:46.684 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.684 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:46.684 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:47.644 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:47.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:47.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:47.695 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:47.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:47.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:47.746 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:47.755 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:47.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:47.806 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:47.806 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:47.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:47.836 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:47.836 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:47.862 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:47.863 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:47.863 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:47.863 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:47.893 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:47.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:47.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:47.894 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:48.864 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:48.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:48.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:48.964 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:48.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:48.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:49.016 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:49.025 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:49.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:49.074 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:49.074 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:49.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:49.100 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:49.100 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:49.130 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:49.130 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:49.130 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:49.130 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:49.157 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:49.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:49.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:49.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:50.131 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:50.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:50.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:50.229 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:50.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:50.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:50.282 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:50.292 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:50.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:50.300 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:50.300 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:50.358 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:50.358 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:50.358 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:50.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:50.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:50.370 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:50.370 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:50.428 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:50.428 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:50.428 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:50.428 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:51.360 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:51.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:51.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:51.458 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:51.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:51.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:51.524 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:51.533 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:51.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:51.542 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:51.542 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:51.598 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:51.599 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:51.599 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:51.599 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:51.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:51.607 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:51.607 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:51.665 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:51.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:51.666 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:51.666 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:52.600 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:52.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:52.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:52.698 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:52.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:52.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:52.751 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:52.760 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:52.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:52.809 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:52.810 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:52.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:52.838 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:52.838 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:52.866 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:52.866 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:52.866 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:52.867 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:52.894 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:52.894 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:52.894 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:52.894 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:53.867 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:53.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:53.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:53.918 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:53.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:53.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:53.969 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:53.978 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:54.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:54.027 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:54.027 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:54.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:54.052 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:54.052 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:54.083 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:54.084 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:54.084 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:54.084 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:54.111 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:54.112 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:54.112 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:54.112 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:55.084 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:55.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:55.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:55.135 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:55.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:55.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:55.186 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:55.196 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:55.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:55.245 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:55.245 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:55.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:55.281 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:55.281 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:55.302 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:55.302 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:55.302 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:55.302 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:55.337 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:55.337 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:55.337 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:55.337 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:56.303 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:56.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:56.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:56.354 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:56.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:56.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:56.405 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:56.414 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:56.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:56.464 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:56.464 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:56.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:56.491 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:56.492 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:56.522 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:56.522 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:56.522 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:56.522 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:56.549 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:56.549 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:56.549 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:56.549 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:57.523 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:57.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:57.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:57.622 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:57.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:57.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:57.674 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:57.683 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:57.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:57.732 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:57.732 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:57.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:57.758 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:57.758 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:57.790 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:57.790 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:57.790 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:57.790 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:57.816 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:57.817 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:57.817 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:57.817 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:58.792 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:58.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:58.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:58.890 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:58.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:58.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:58.943 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:14:58.952 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:14:58.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:14:58.960 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:58.960 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:14:59.017 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:59.017 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:59.017 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:59.017 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:59.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:14:59.024 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:59.025 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:14:59.082 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:59.082 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:59.082 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:59.082 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:00.018 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:00.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:00.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:00.120 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:00.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:00.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:00.172 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:15:00.181 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:15:00.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:00.231 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:00.232 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:15:00.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:00.263 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:00.263 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:15:00.288 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:00.289 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:00.289 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:00.289 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:00.319 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:00.320 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:00.320 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:00.320 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:01.290 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:01.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:01.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:01.386 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:01.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:01.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:01.438 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:15:01.447 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:15:01.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:01.496 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:01.496 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:15:01.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:01.520 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:01.520 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:15:01.554 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:01.554 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:01.554 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:01.554 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:01.577 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:01.578 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:01.578 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:01.578 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:02.555 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:02.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:02.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:02.606 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:02.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:02.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:02.658 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:15:02.667 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:15:02.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:02.716 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:02.716 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:15:02.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:02.754 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:02.754 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:15:02.773 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:02.773 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:02.773 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:02.773 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:02.811 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:02.811 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:02.811 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:02.812 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:03.774 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:03.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:03.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:03.872 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:03.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:03.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:03.924 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:15:03.934 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:15:03.983 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:03.983 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:03.983 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:15:04.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:04.007 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:04.007 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:15:04.039 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:04.039 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:04.039 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:04.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:04.064 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:04.064 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:04.064 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:04.064 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:05.040 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:05.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:05.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:05.140 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:05.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:05.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:05.192 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:15:05.202 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:15:05.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:05.252 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:05.252 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:15:05.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:05.288 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:05.289 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:15:05.308 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:05.309 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:05.309 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:05.309 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:05.346 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:05.347 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:05.347 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:05.347 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:06.310 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:06.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:06.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:06.409 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:06.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:06.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:06.461 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:15:06.470 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:15:06.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:06.519 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:06.519 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:15:06.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:06.546 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:06.546 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:15:06.577 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:06.577 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:06.577 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:06.577 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:06.603 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:06.604 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:06.604 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:06.604 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:07.578 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:07.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:07.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:07.677 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:07.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:07.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:07.729 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:15:07.739 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:15:07.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:07.748 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:07.749 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:15:07.805 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:07.805 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:07.806 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:07.806 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:07.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:07.821 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:07.821 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:15:07.878 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:07.879 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:07.879 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:07.879 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:08.806 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:08.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:08.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:08.906 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:08.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:08.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:08.959 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:15:08.968 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:15:08.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:08.977 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:08.977 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:15:09.034 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:09.034 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:09.034 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:09.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:09.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:09.056 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:09.056 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:15:09.114 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:09.114 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:09.114 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:09.114 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:10.035 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:10.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:10.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:10.134 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:10.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:10.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:10.186 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:15:10.195 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:15:10.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:10.244 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:10.244 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:15:10.287 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:10.287 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:10.287 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:15:10.301 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:10.301 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:10.301 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:10.301 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:10.344 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:10.344 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:10.344 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:10.344 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:11.302 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:11.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:11.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:11.401 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:11.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:11.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:11.453 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:15:11.462 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:15:11.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:11.513 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:11.513 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:15:11.553 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:11.554 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:11.554 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:15:11.571 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:11.571 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:11.571 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:11.571 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:11.611 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:11.611 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:11.611 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:11.611 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:12.572 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:12.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:12.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:12.669 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:12.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:12.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial024.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:12.721 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-12T22:15:12.731 DEBUG:teuthology.orchestra.run.trial024:> true 2026-02-12T22:15:12.780 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-12T22:15:12.780 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:12.780 DEBUG:teuthology.orchestra.run.trial168:> uname -r 2026-02-12T22:15:12.812 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial024.front.sepia.ceph.com' 2026-02-12T22:15:12.812 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:12.813 DEBUG:teuthology.orchestra.run.trial024:> uname -r 2026-02-12T22:15:12.838 INFO:teuthology.orchestra.run.trial168.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:12.838 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:12.838 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:12.838 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:12.839 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:12.842 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:15:12.854 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:15:12.890 INFO:teuthology.run:Summary data: description: fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/charmap} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:15:12.890 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:15:12.975 INFO:teuthology.orchestra.run.trial024.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:12.975 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:12.975 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:12.975 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:13.012 INFO:teuthology.run:FAIL