2026-02-12T22:13:59.030 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:13:59.045 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:13:59.125 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47160 branch: wip-pdonnell-testing-20260210.171210 description: fs/32bits/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_pjd} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47160' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client use faked inos: true fuse set user groups: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFhH8o+Xz7GFbkIzsOiOpbHGDYd/3XFGUUIX7ehYYeAmLUsQPnTYZNwkm5dfnwLBmlk2N2o00poPW4/XYwru11A= trial180.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ0k75zcofcEdmu8vCpqbpPJEG8V2jZ49dRN9uQbpSlETYOd49CTC4Stbp5QegidfkrPZSJU1epOfsWzkl3SWUY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - ceph-fuse: null - workunit: clients: all: - suites/pjd.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:13:59.125 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:13:59.125 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:13:59.125 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:13:59.127 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:13:59.127 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:13:59.127 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:13:59.127 INFO:teuthology.packaging:ref: None 2026-02-12T22:13:59.127 INFO:teuthology.packaging:tag: None 2026-02-12T22:13:59.127 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:13:59.127 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:13:59.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:13:59.251 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:13:59.252 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:13:59.267 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:13:59.267 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:13:59.279 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:13:59.295 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:13:59.306 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:13:59.381 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial133.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47160', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:10:36.223602', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFhH8o+Xz7GFbkIzsOiOpbHGDYd/3XFGUUIX7ehYYeAmLUsQPnTYZNwkm5dfnwLBmlk2N2o00poPW4/XYwru11A='} 2026-02-12T22:13:59.435 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial180.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47160', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:10:36.222883', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ0k75zcofcEdmu8vCpqbpPJEG8V2jZ49dRN9uQbpSlETYOd49CTC4Stbp5QegidfkrPZSJU1epOfsWzkl3SWUY='} 2026-02-12T22:13:59.435 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:13:59.446 INFO:teuthology.task.internal:roles: ubuntu@trial133.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-12T22:13:59.446 INFO:teuthology.task.internal:roles: ubuntu@trial180.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2026-02-12T22:13:59.446 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:13:59.580 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x79c526db8860>, signals=[15]) 2026-02-12T22:13:59.580 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:13:59.594 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:13:59.594 DEBUG:teuthology.task.internal:connecting to ubuntu@trial133.front.sepia.ceph.com 2026-02-12T22:13:59.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:59.655 DEBUG:teuthology.task.internal:connecting to ubuntu@trial180.front.sepia.ceph.com 2026-02-12T22:13:59.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:59.716 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:13:59.726 DEBUG:teuthology.orchestra.run.trial133:> uname -m 2026-02-12T22:13:59.743 INFO:teuthology.orchestra.run.trial133.stdout:x86_64 2026-02-12T22:13:59.743 DEBUG:teuthology.orchestra.run.trial133:> cat /etc/os-release 2026-02-12T22:13:59.801 INFO:teuthology.orchestra.run.trial133.stdout:NAME="Rocky Linux" 2026-02-12T22:13:59.801 INFO:teuthology.orchestra.run.trial133.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:13:59.801 INFO:teuthology.orchestra.run.trial133.stdout:ID="rocky" 2026-02-12T22:13:59.801 INFO:teuthology.orchestra.run.trial133.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:13:59.801 INFO:teuthology.orchestra.run.trial133.stdout:VERSION_ID="10.1" 2026-02-12T22:13:59.801 INFO:teuthology.orchestra.run.trial133.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:13:59.801 INFO:teuthology.orchestra.run.trial133.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:13:59.801 INFO:teuthology.orchestra.run.trial133.stdout:ANSI_COLOR="0;32" 2026-02-12T22:13:59.802 INFO:teuthology.orchestra.run.trial133.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:13:59.802 INFO:teuthology.orchestra.run.trial133.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:13:59.802 INFO:teuthology.orchestra.run.trial133.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:13:59.802 INFO:teuthology.orchestra.run.trial133.stdout:VENDOR_NAME="RESF" 2026-02-12T22:13:59.802 INFO:teuthology.orchestra.run.trial133.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:13:59.802 INFO:teuthology.orchestra.run.trial133.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:13:59.802 INFO:teuthology.orchestra.run.trial133.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:13:59.802 INFO:teuthology.orchestra.run.trial133.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:13:59.802 INFO:teuthology.orchestra.run.trial133.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:13:59.802 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:13:59.802 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:13:59.802 INFO:teuthology.lock.ops:Updating trial133.front.sepia.ceph.com on lock server 2026-02-12T22:13:59.874 DEBUG:teuthology.orchestra.run.trial180:> uname -m 2026-02-12T22:13:59.892 INFO:teuthology.orchestra.run.trial180.stdout:x86_64 2026-02-12T22:13:59.892 DEBUG:teuthology.orchestra.run.trial180:> cat /etc/os-release 2026-02-12T22:13:59.949 INFO:teuthology.orchestra.run.trial180.stdout:NAME="Rocky Linux" 2026-02-12T22:13:59.949 INFO:teuthology.orchestra.run.trial180.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:13:59.949 INFO:teuthology.orchestra.run.trial180.stdout:ID="rocky" 2026-02-12T22:13:59.949 INFO:teuthology.orchestra.run.trial180.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:13:59.949 INFO:teuthology.orchestra.run.trial180.stdout:VERSION_ID="10.1" 2026-02-12T22:13:59.949 INFO:teuthology.orchestra.run.trial180.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:13:59.949 INFO:teuthology.orchestra.run.trial180.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:13:59.949 INFO:teuthology.orchestra.run.trial180.stdout:ANSI_COLOR="0;32" 2026-02-12T22:13:59.950 INFO:teuthology.orchestra.run.trial180.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:13:59.950 INFO:teuthology.orchestra.run.trial180.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:13:59.950 INFO:teuthology.orchestra.run.trial180.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:13:59.950 INFO:teuthology.orchestra.run.trial180.stdout:VENDOR_NAME="RESF" 2026-02-12T22:13:59.950 INFO:teuthology.orchestra.run.trial180.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:13:59.950 INFO:teuthology.orchestra.run.trial180.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:13:59.950 INFO:teuthology.orchestra.run.trial180.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:13:59.950 INFO:teuthology.orchestra.run.trial180.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:13:59.950 INFO:teuthology.orchestra.run.trial180.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:13:59.950 INFO:teuthology.orchestra.run.trial180.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:13:59.950 INFO:teuthology.orchestra.run.trial180.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:13:59.950 INFO:teuthology.lock.ops:Updating trial180.front.sepia.ceph.com on lock server 2026-02-12T22:14:00.026 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:14:00.038 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:14:00.049 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:14:00.049 DEBUG:teuthology.orchestra.run.trial133:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:14:00.050 DEBUG:teuthology.orchestra.run.trial180:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:14:00.066 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:14:00.077 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:14:00.077 DEBUG:teuthology.orchestra.run.trial133:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:14:00.108 DEBUG:teuthology.orchestra.run.trial180:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:14:00.123 INFO:teuthology.orchestra.run.trial133.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:14:00.125 INFO:teuthology.orchestra.run.trial180.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:14:00.126 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:14:00.282 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:14:00.300 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:14:00.300 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:14:00.300 DEBUG:teuthology.orchestra.run.trial133:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:14:00.300 DEBUG:teuthology.orchestra.run.trial180:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:14:00.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:14:00.316 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:14:00.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:14:00.317 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:14:00.373 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:00.373 INFO:teuthology.task.kernel:Running kernel on trial133: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:00.373 DEBUG:teuthology.orchestra.run.trial133:> sudo yum install -y kernel 2026-02-12T22:14:00.374 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:00.374 INFO:teuthology.task.kernel:Running kernel on trial180: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:00.374 DEBUG:teuthology.orchestra.run.trial180:> sudo yum install -y kernel 2026-02-12T22:14:00.935 INFO:teuthology.orchestra.run.trial180.stdout:Rocky Linux 10 - AppStream 14 MB/s | 2.2 MB 00:00 2026-02-12T22:14:00.940 INFO:teuthology.orchestra.run.trial133.stdout:Rocky Linux 10 - AppStream 13 MB/s | 2.2 MB 00:00 2026-02-12T22:14:01.272 INFO:teuthology.orchestra.run.trial133.stdout:Rocky Linux 10 - BaseOS 52 MB/s | 11 MB 00:00 2026-02-12T22:14:01.282 INFO:teuthology.orchestra.run.trial180.stdout:Rocky Linux 10 - BaseOS 49 MB/s | 11 MB 00:00 2026-02-12T22:14:01.761 INFO:teuthology.orchestra.run.trial133.stdout:Rocky Linux 10 - CRB 6.5 MB/s | 503 kB 00:00 2026-02-12T22:14:01.768 INFO:teuthology.orchestra.run.trial180.stdout:Rocky Linux 10 - CRB 6.6 MB/s | 503 kB 00:00 2026-02-12T22:14:02.309 INFO:teuthology.orchestra.run.trial133.stdout:Extra Packages for Enterprise Linux 12 MB/s | 6.2 MB 00:00 2026-02-12T22:14:02.501 INFO:teuthology.orchestra.run.trial180.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 6.2 MB 00:00 2026-02-12T22:14:02.988 INFO:teuthology.orchestra.run.trial133.stdout:lab-extras 118 kB/s | 3.7 kB 00:00 2026-02-12T22:14:03.156 INFO:teuthology.orchestra.run.trial180.stdout:lab-extras 313 kB/s | 3.7 kB 00:00 2026-02-12T22:14:03.405 INFO:teuthology.orchestra.run.trial133.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:14:03.417 INFO:teuthology.orchestra.run.trial133.stdout:Dependencies resolved. 2026-02-12T22:14:03.418 INFO:teuthology.orchestra.run.trial133.stdout:================================================================================ 2026-02-12T22:14:03.418 INFO:teuthology.orchestra.run.trial133.stdout: Package Arch Version Repo Size 2026-02-12T22:14:03.418 INFO:teuthology.orchestra.run.trial133.stdout:================================================================================ 2026-02-12T22:14:03.418 INFO:teuthology.orchestra.run.trial133.stdout:Installing: 2026-02-12T22:14:03.418 INFO:teuthology.orchestra.run.trial133.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:14:03.418 INFO:teuthology.orchestra.run.trial133.stdout:Installing dependencies: 2026-02-12T22:14:03.418 INFO:teuthology.orchestra.run.trial133.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:14:03.418 INFO:teuthology.orchestra.run.trial133.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:14:03.419 INFO:teuthology.orchestra.run.trial133.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:14:03.419 INFO:teuthology.orchestra.run.trial133.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:14:03.419 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-12T22:14:03.419 INFO:teuthology.orchestra.run.trial133.stdout:Transaction Summary 2026-02-12T22:14:03.419 INFO:teuthology.orchestra.run.trial133.stdout:================================================================================ 2026-02-12T22:14:03.419 INFO:teuthology.orchestra.run.trial133.stdout:Install 5 Packages 2026-02-12T22:14:03.419 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-12T22:14:03.419 INFO:teuthology.orchestra.run.trial133.stdout:Total download size: 93 M 2026-02-12T22:14:03.419 INFO:teuthology.orchestra.run.trial133.stdout:Installed size: 135 M 2026-02-12T22:14:03.419 INFO:teuthology.orchestra.run.trial133.stdout:Downloading Packages: 2026-02-12T22:14:03.473 INFO:teuthology.orchestra.run.trial133.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 25 MB/s | 1.4 MB 00:00 2026-02-12T22:14:03.572 INFO:teuthology.orchestra.run.trial180.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:14:03.584 INFO:teuthology.orchestra.run.trial180.stdout:Dependencies resolved. 2026-02-12T22:14:03.585 INFO:teuthology.orchestra.run.trial180.stdout:================================================================================ 2026-02-12T22:14:03.585 INFO:teuthology.orchestra.run.trial180.stdout: Package Arch Version Repo Size 2026-02-12T22:14:03.585 INFO:teuthology.orchestra.run.trial180.stdout:================================================================================ 2026-02-12T22:14:03.585 INFO:teuthology.orchestra.run.trial180.stdout:Installing: 2026-02-12T22:14:03.585 INFO:teuthology.orchestra.run.trial180.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:14:03.585 INFO:teuthology.orchestra.run.trial180.stdout:Installing dependencies: 2026-02-12T22:14:03.586 INFO:teuthology.orchestra.run.trial180.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:14:03.586 INFO:teuthology.orchestra.run.trial180.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:14:03.586 INFO:teuthology.orchestra.run.trial180.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:14:03.586 INFO:teuthology.orchestra.run.trial180.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:14:03.586 INFO:teuthology.orchestra.run.trial180.stdout: 2026-02-12T22:14:03.586 INFO:teuthology.orchestra.run.trial180.stdout:Transaction Summary 2026-02-12T22:14:03.586 INFO:teuthology.orchestra.run.trial180.stdout:================================================================================ 2026-02-12T22:14:03.586 INFO:teuthology.orchestra.run.trial180.stdout:Install 5 Packages 2026-02-12T22:14:03.586 INFO:teuthology.orchestra.run.trial180.stdout: 2026-02-12T22:14:03.587 INFO:teuthology.orchestra.run.trial180.stdout:Total download size: 93 M 2026-02-12T22:14:03.587 INFO:teuthology.orchestra.run.trial180.stdout:Installed size: 135 M 2026-02-12T22:14:03.587 INFO:teuthology.orchestra.run.trial180.stdout:Downloading Packages: 2026-02-12T22:14:03.636 INFO:teuthology.orchestra.run.trial180.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 28 MB/s | 1.4 MB 00:00 2026-02-12T22:14:03.709 INFO:teuthology.orchestra.run.trial133.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 63 MB/s | 18 MB 00:00 2026-02-12T22:14:03.767 INFO:teuthology.orchestra.run.trial133.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 48 MB/s | 2.8 MB 00:00 2026-02-12T22:14:03.922 INFO:teuthology.orchestra.run.trial133.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 66 MB/s | 30 MB 00:00 2026-02-12T22:14:03.966 INFO:teuthology.orchestra.run.trial180.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 49 MB/s | 18 MB 00:00 2026-02-12T22:14:03.983 INFO:teuthology.orchestra.run.trial133.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 72 MB/s | 41 MB 00:00 2026-02-12T22:14:03.983 INFO:teuthology.orchestra.run.trial133.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:14:03.984 INFO:teuthology.orchestra.run.trial133.stdout:Total 164 MB/s | 93 MB 00:00 2026-02-12T22:14:03.984 INFO:teuthology.orchestra.run.trial133.stdout:Running transaction check 2026-02-12T22:14:04.007 INFO:teuthology.orchestra.run.trial180.stdout:(3/5): kernel-modules-core-6.12.0-124.31.1.el10 79 MB/s | 30 MB 00:00 2026-02-12T22:14:04.041 INFO:teuthology.orchestra.run.trial180.stdout:(4/5): kernel-modules-extra-6.12.0-124.31.1.el1 37 MB/s | 2.8 MB 00:00 2026-02-12T22:14:04.131 INFO:teuthology.orchestra.run.trial133.stdout:Transaction check succeeded. 2026-02-12T22:14:04.131 INFO:teuthology.orchestra.run.trial133.stdout:Running transaction test 2026-02-12T22:14:04.199 INFO:teuthology.orchestra.run.trial180.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 66 MB/s | 41 MB 00:00 2026-02-12T22:14:04.200 INFO:teuthology.orchestra.run.trial180.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:14:04.200 INFO:teuthology.orchestra.run.trial180.stdout:Total 151 MB/s | 93 MB 00:00 2026-02-12T22:14:04.200 INFO:teuthology.orchestra.run.trial180.stdout:Running transaction check 2026-02-12T22:14:04.347 INFO:teuthology.orchestra.run.trial180.stdout:Transaction check succeeded. 2026-02-12T22:14:04.347 INFO:teuthology.orchestra.run.trial180.stdout:Running transaction test 2026-02-12T22:14:04.533 INFO:teuthology.orchestra.run.trial133.stdout:Transaction test succeeded. 2026-02-12T22:14:04.533 INFO:teuthology.orchestra.run.trial133.stdout:Running transaction 2026-02-12T22:14:04.756 INFO:teuthology.orchestra.run.trial180.stdout:Transaction test succeeded. 2026-02-12T22:14:04.756 INFO:teuthology.orchestra.run.trial180.stdout:Running transaction 2026-02-12T22:14:05.231 INFO:teuthology.orchestra.run.trial133.stdout: Preparing : 1/1 2026-02-12T22:14:05.432 INFO:teuthology.orchestra.run.trial133.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:14:05.454 INFO:teuthology.orchestra.run.trial133.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:14:05.457 INFO:teuthology.orchestra.run.trial180.stdout: Preparing : 1/1 2026-02-12T22:14:05.659 INFO:teuthology.orchestra.run.trial180.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:14:05.680 INFO:teuthology.orchestra.run.trial180.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:14:06.707 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:14:06.734 INFO:teuthology.orchestra.run.trial133.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:14:06.942 INFO:teuthology.orchestra.run.trial180.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:14:06.970 INFO:teuthology.orchestra.run.trial180.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:14:08.579 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:14:08.585 INFO:teuthology.orchestra.run.trial133.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:14:08.813 INFO:teuthology.orchestra.run.trial180.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:14:08.818 INFO:teuthology.orchestra.run.trial180.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:14:10.443 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:14:10.452 INFO:teuthology.orchestra.run.trial133.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:14:10.675 INFO:teuthology.orchestra.run.trial180.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:14:10.685 INFO:teuthology.orchestra.run.trial180.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:14:12.314 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:14:12.545 INFO:teuthology.orchestra.run.trial180.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:14:45.959 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:14:45.982 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:14:46.102 INFO:teuthology.orchestra.run.trial133.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:14:46.103 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-12T22:14:46.103 INFO:teuthology.orchestra.run.trial133.stdout:Installed: 2026-02-12T22:14:46.103 INFO:teuthology.orchestra.run.trial133.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.103 INFO:teuthology.orchestra.run.trial133.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.103 INFO:teuthology.orchestra.run.trial133.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.103 INFO:teuthology.orchestra.run.trial133.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.103 INFO:teuthology.orchestra.run.trial133.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.103 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-12T22:14:46.103 INFO:teuthology.orchestra.run.trial133.stdout:Complete! 2026-02-12T22:14:46.168 DEBUG:teuthology.orchestra.run.trial133:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:14:46.240 INFO:teuthology.orchestra.run.trial133.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.242 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.242 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.242 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:14:46.242 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:14:46.242 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:14:46.242 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial133.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:14:46.242 DEBUG:teuthology.orchestra.run.trial133:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:14:46.314 INFO:teuthology.orchestra.run.trial133.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.315 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.315 DEBUG:teuthology.orchestra.run.trial133:> sudo rpm -qi grub2-tools 2026-02-12T22:14:46.334 INFO:teuthology.orchestra.run.trial180.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:14:46.357 INFO:teuthology.orchestra.run.trial180.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:14:46.385 INFO:teuthology.orchestra.run.trial133.stdout:Name : grub2-tools 2026-02-12T22:14:46.385 INFO:teuthology.orchestra.run.trial133.stdout:Epoch : 1 2026-02-12T22:14:46.385 INFO:teuthology.orchestra.run.trial133.stdout:Version : 2.12 2026-02-12T22:14:46.385 INFO:teuthology.orchestra.run.trial133.stdout:Release : 29.el10_1 2026-02-12T22:14:46.386 INFO:teuthology.orchestra.run.trial133.stdout:Architecture: x86_64 2026-02-12T22:14:46.386 INFO:teuthology.orchestra.run.trial133.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:14:46.386 INFO:teuthology.orchestra.run.trial133.stdout:Group : Unspecified 2026-02-12T22:14:46.386 INFO:teuthology.orchestra.run.trial133.stdout:Size : 7963769 2026-02-12T22:14:46.386 INFO:teuthology.orchestra.run.trial133.stdout:License : GPL-3.0-or-later 2026-02-12T22:14:46.386 INFO:teuthology.orchestra.run.trial133.stdout:Signature : 2026-02-12T22:14:46.386 INFO:teuthology.orchestra.run.trial133.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:14:46.386 INFO:teuthology.orchestra.run.trial133.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:14:46.386 INFO:teuthology.orchestra.run.trial133.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:14:46.386 INFO:teuthology.orchestra.run.trial133.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:14:46.386 INFO:teuthology.orchestra.run.trial133.stdout:Packager : Release Engineering 2026-02-12T22:14:46.386 INFO:teuthology.orchestra.run.trial133.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:14:46.386 INFO:teuthology.orchestra.run.trial133.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:14:46.386 INFO:teuthology.orchestra.run.trial133.stdout:Summary : Support tools for GRUB. 2026-02-12T22:14:46.386 INFO:teuthology.orchestra.run.trial133.stdout:Description : 2026-02-12T22:14:46.387 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-12T22:14:46.387 INFO:teuthology.orchestra.run.trial133.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:14:46.387 INFO:teuthology.orchestra.run.trial133.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:14:46.387 INFO:teuthology.orchestra.run.trial133.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:14:46.387 INFO:teuthology.orchestra.run.trial133.stdout:hardware devices. 2026-02-12T22:14:46.387 INFO:teuthology.orchestra.run.trial133.stdout: 2026-02-12T22:14:46.387 INFO:teuthology.orchestra.run.trial133.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:14:46.388 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:14:46.388 INFO:teuthology.task.kernel:Updating grub on trial133 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.388 DEBUG:teuthology.orchestra.run.trial133:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:14:46.453 INFO:teuthology.orchestra.run.trial133.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:14:46.454 DEBUG:teuthology.orchestra.run.trial133:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:14:46.520 INFO:teuthology.orchestra.run.trial133.stdout:/sbin/grubby 2026-02-12T22:14:46.521 INFO:teuthology.orchestra.run.trial133.stdout:yes 2026-02-12T22:14:46.522 DEBUG:teuthology.orchestra.run.trial133:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:14:46.587 INFO:teuthology.orchestra.run.trial133.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:14:46.588 DEBUG:teuthology.orchestra.run.trial133:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.589 INFO:teuthology.orchestra.run.trial180.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:14:46.589 INFO:teuthology.orchestra.run.trial180.stdout: 2026-02-12T22:14:46.589 INFO:teuthology.orchestra.run.trial180.stdout:Installed: 2026-02-12T22:14:46.589 INFO:teuthology.orchestra.run.trial180.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.589 INFO:teuthology.orchestra.run.trial180.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.590 INFO:teuthology.orchestra.run.trial180.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.590 INFO:teuthology.orchestra.run.trial180.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.590 INFO:teuthology.orchestra.run.trial180.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.590 INFO:teuthology.orchestra.run.trial180.stdout: 2026-02-12T22:14:46.590 INFO:teuthology.orchestra.run.trial180.stdout:Complete! 2026-02-12T22:14:46.653 DEBUG:teuthology.orchestra.run.trial180:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:14:46.665 DEBUG:teuthology.orchestra.run.trial133:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:14:46.687 INFO:teuthology.orchestra.run.trial180.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.688 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.689 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.689 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:14:46.689 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:14:46.689 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:14:46.689 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial180.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:14:46.689 DEBUG:teuthology.orchestra.run.trial180:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:14:46.760 INFO:teuthology.orchestra.run.trial180.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.761 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.761 DEBUG:teuthology.orchestra.run.trial180:> sudo rpm -qi grub2-tools 2026-02-12T22:14:46.776 INFO:teuthology.orchestra.run.trial133.stderr:Generating grub configuration file ... 2026-02-12T22:14:46.831 INFO:teuthology.orchestra.run.trial180.stdout:Name : grub2-tools 2026-02-12T22:14:46.832 INFO:teuthology.orchestra.run.trial180.stdout:Epoch : 1 2026-02-12T22:14:46.832 INFO:teuthology.orchestra.run.trial180.stdout:Version : 2.12 2026-02-12T22:14:46.832 INFO:teuthology.orchestra.run.trial180.stdout:Release : 29.el10_1 2026-02-12T22:14:46.832 INFO:teuthology.orchestra.run.trial180.stdout:Architecture: x86_64 2026-02-12T22:14:46.832 INFO:teuthology.orchestra.run.trial180.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:14:46.832 INFO:teuthology.orchestra.run.trial180.stdout:Group : Unspecified 2026-02-12T22:14:46.832 INFO:teuthology.orchestra.run.trial180.stdout:Size : 7963769 2026-02-12T22:14:46.832 INFO:teuthology.orchestra.run.trial180.stdout:License : GPL-3.0-or-later 2026-02-12T22:14:46.832 INFO:teuthology.orchestra.run.trial180.stdout:Signature : 2026-02-12T22:14:46.833 INFO:teuthology.orchestra.run.trial180.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:14:46.833 INFO:teuthology.orchestra.run.trial180.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:14:46.833 INFO:teuthology.orchestra.run.trial180.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:14:46.833 INFO:teuthology.orchestra.run.trial180.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:14:46.833 INFO:teuthology.orchestra.run.trial180.stdout:Packager : Release Engineering 2026-02-12T22:14:46.833 INFO:teuthology.orchestra.run.trial180.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:14:46.833 INFO:teuthology.orchestra.run.trial180.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:14:46.833 INFO:teuthology.orchestra.run.trial180.stdout:Summary : Support tools for GRUB. 2026-02-12T22:14:46.833 INFO:teuthology.orchestra.run.trial180.stdout:Description : 2026-02-12T22:14:46.833 INFO:teuthology.orchestra.run.trial180.stdout: 2026-02-12T22:14:46.833 INFO:teuthology.orchestra.run.trial180.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:14:46.833 INFO:teuthology.orchestra.run.trial180.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:14:46.834 INFO:teuthology.orchestra.run.trial180.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:14:46.834 INFO:teuthology.orchestra.run.trial180.stdout:hardware devices. 2026-02-12T22:14:46.834 INFO:teuthology.orchestra.run.trial180.stdout: 2026-02-12T22:14:46.834 INFO:teuthology.orchestra.run.trial180.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:14:46.835 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:14:46.835 INFO:teuthology.task.kernel:Updating grub on trial180 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.835 DEBUG:teuthology.orchestra.run.trial180:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:14:46.900 INFO:teuthology.orchestra.run.trial180.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:14:46.902 DEBUG:teuthology.orchestra.run.trial180:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:14:46.951 INFO:teuthology.orchestra.run.trial133.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:14:46.960 INFO:teuthology.orchestra.run.trial133.stderr:done 2026-02-12T22:14:46.962 DEBUG:teuthology.orchestra.run.trial133:> test -d /sys/firmware/efi 2026-02-12T22:14:46.966 INFO:teuthology.orchestra.run.trial180.stdout:/sbin/grubby 2026-02-12T22:14:46.968 INFO:teuthology.orchestra.run.trial180.stdout:yes 2026-02-12T22:14:46.968 DEBUG:teuthology.orchestra.run.trial180:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:14:46.979 DEBUG:teuthology.orchestra.run.trial133:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:14:47.035 INFO:teuthology.orchestra.run.trial180.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:14:47.036 DEBUG:teuthology.orchestra.run.trial180:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:47.050 INFO:teuthology.orchestra.run.trial133.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:14:47.051 INFO:teuthology.orchestra.run.trial133.stdout:/boot/efi/EFI/rocky 2026-02-12T22:14:47.052 DEBUG:teuthology.orchestra.run.trial133:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:14:47.112 DEBUG:teuthology.orchestra.run.trial180:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:14:47.119 INFO:teuthology.orchestra.run.trial133.stdout:no 2026-02-12T22:14:47.119 DEBUG:teuthology.orchestra.run.trial133:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:14:47.186 INFO:teuthology.orchestra.run.trial133.stdout:yes 2026-02-12T22:14:47.186 DEBUG:teuthology.orchestra.run.trial133:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:14:47.223 INFO:teuthology.orchestra.run.trial180.stderr:Generating grub configuration file ... 2026-02-12T22:14:47.252 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial133 2026-02-12T22:14:47.253 DEBUG:teuthology.orchestra.run.trial133:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:14:47.316 INFO:teuthology.orchestra.run.trial133.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:14:47.400 INFO:teuthology.orchestra.run.trial180.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:14:47.409 INFO:teuthology.orchestra.run.trial180.stderr:done 2026-02-12T22:14:47.411 DEBUG:teuthology.orchestra.run.trial180:> test -d /sys/firmware/efi 2026-02-12T22:14:47.428 DEBUG:teuthology.orchestra.run.trial180:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:14:47.496 INFO:teuthology.orchestra.run.trial180.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:14:47.496 INFO:teuthology.orchestra.run.trial180.stdout:/boot/efi/EFI/rocky 2026-02-12T22:14:47.498 DEBUG:teuthology.orchestra.run.trial180:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:14:47.565 INFO:teuthology.orchestra.run.trial180.stdout:no 2026-02-12T22:14:47.566 DEBUG:teuthology.orchestra.run.trial180:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:14:47.633 INFO:teuthology.orchestra.run.trial180.stdout:yes 2026-02-12T22:14:47.633 DEBUG:teuthology.orchestra.run.trial180:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:14:47.699 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial180 2026-02-12T22:14:47.699 DEBUG:teuthology.orchestra.run.trial180:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:14:47.765 INFO:teuthology.orchestra.run.trial180.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:15:17.294 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:17.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:17.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:17.405 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:17.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:17.493 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:17.493 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:17.549 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:17.549 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:17.550 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:17.550 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:17.742 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:17.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:17.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:17.854 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:17.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:17.937 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:17.937 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:17.994 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:17.995 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:17.995 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:17.995 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:18.552 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:18.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:18.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:18.661 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:18.739 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:18.739 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:18.739 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:18.795 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:18.795 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:18.795 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:18.795 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:18.996 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:18.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:18.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:19.106 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:19.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:19.183 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:19.183 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:19.241 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:19.241 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:19.241 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:19.241 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:19.796 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:19.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:19.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:19.906 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:19.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:19.992 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:19.992 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:20.049 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:20.050 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:20.050 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:20.050 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:20.243 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:20.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:20.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:20.353 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:20.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:20.429 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:20.429 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:20.487 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:20.488 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:20.488 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:20.488 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:21.051 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:21.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:21.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:21.160 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:21.237 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:21.237 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:21.237 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:21.295 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:21.295 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:21.295 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:21.295 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:21.489 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:21.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:21.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:21.598 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:21.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:21.684 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:21.684 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:21.741 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:21.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:21.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:21.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:22.297 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:22.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:22.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:22.405 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:22.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:22.480 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:22.480 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:22.536 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:22.537 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:22.537 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:22.537 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:22.742 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:22.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:22.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:22.851 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:22.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:22.925 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:22.925 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:22.982 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:22.983 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:22.983 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:22.983 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:23.538 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:23.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:23.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:23.646 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:23.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:23.727 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:23.727 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:23.784 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:23.784 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:23.784 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:23.784 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:23.985 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:23.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:23.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:24.094 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:24.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:24.166 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:24.166 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:24.223 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:24.223 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:24.223 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:24.223 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:24.786 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:24.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:24.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:24.894 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:24.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:24.981 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:24.981 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:25.038 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:25.038 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:25.038 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:25.038 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:25.224 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:25.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:25.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:25.297 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:25.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:25.383 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:25.383 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:25.439 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:25.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:25.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:25.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:26.040 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:26.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:26.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:26.148 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:26.227 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:26.227 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:26.227 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:26.283 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:26.284 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:26.284 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:26.284 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:26.440 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:26.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:26.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:26.549 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:26.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:26.632 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:26.632 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:26.689 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:26.690 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:26.690 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:26.690 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:27.285 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:27.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:27.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:27.395 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:27.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:27.483 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:27.483 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:27.540 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:27.540 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:27.540 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:27.541 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:27.691 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:27.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:27.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:27.799 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:27.875 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:27.875 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:27.875 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:27.932 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:27.933 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:27.933 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:27.933 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:28.541 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:28.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:28.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:28.650 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:28.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:28.736 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:28.736 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:28.794 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:28.795 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:28.795 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:28.795 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:28.934 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:28.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:28.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:29.043 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:29.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:29.118 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:29.118 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:29.175 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:29.176 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:29.176 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:29.176 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:29.796 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:29.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:29.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:29.905 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:29.983 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:29.983 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:29.983 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:30.040 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:30.041 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:30.041 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:30.041 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:30.177 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:30.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:30.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:30.286 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:30.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:30.361 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:30.362 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:30.418 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:30.419 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:30.419 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:30.419 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:31.042 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:31.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:31.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:31.151 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:31.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:31.236 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:31.237 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:31.287 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:31.288 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:31.288 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:31.288 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:31.420 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:31.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:31.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:31.529 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:31.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:31.613 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:31.613 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:31.670 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:31.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:31.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:31.671 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:32.289 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:32.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:32.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:32.395 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:32.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:32.477 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:32.477 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:32.534 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:32.535 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:32.535 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:32.535 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:32.671 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:32.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:32.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:32.750 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:32.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:32.832 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:32.832 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:32.890 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:32.890 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:32.890 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:32.890 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:33.536 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:33.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:33.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:33.645 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:33.723 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:33.723 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:33.724 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:33.780 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:33.781 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:33.781 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:33.781 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:33.891 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:33.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:33.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:34.000 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:34.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:34.072 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:34.072 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:34.129 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:34.130 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:34.130 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:34.130 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:34.782 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:34.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:34.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:34.891 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:34.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:34.971 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:34.971 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:35.027 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:35.028 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:35.028 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:35.028 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:35.131 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:35.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:35.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:35.240 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:35.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:35.314 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:35.314 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:35.372 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:35.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:35.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:35.373 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:36.029 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:36.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:36.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:36.138 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:36.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:36.213 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:36.213 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:36.270 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:36.270 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:36.270 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:36.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:36.374 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:36.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:36.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:36.481 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:36.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:36.554 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:36.555 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:36.612 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:36.612 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:36.612 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:36.612 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:37.272 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:37.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:37.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:37.382 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:37.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:37.458 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:37.459 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:37.516 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:37.516 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:37.516 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:37.517 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:37.614 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:37.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:37.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:37.722 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:37.799 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:37.799 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:37.800 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:37.856 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:37.857 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:37.857 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:37.857 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:38.518 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:38.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:38.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:38.626 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:38.703 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:38.703 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:38.703 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:38.760 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:38.761 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:38.761 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:38.761 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:38.858 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:38.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:38.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:38.966 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:39.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:39.046 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:39.046 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:39.103 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:39.104 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:39.104 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:39.104 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:39.763 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:39.763 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:39.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:39.872 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:39.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:39.962 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:39.962 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:40.019 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:40.019 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:40.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:40.019 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:40.105 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:40.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:40.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:40.212 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:40.287 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:40.287 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:40.287 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:40.343 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:40.344 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:40.344 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:40.344 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:41.021 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:41.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:41.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:41.129 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:41.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:41.211 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:41.212 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:41.268 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:41.268 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:41.268 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:41.268 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:41.346 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:41.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:41.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:41.453 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:41.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:41.535 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:41.535 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:41.592 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:41.593 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:41.593 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:41.593 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:42.269 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:42.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:42.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:42.378 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:42.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:42.463 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:42.464 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:42.520 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:42.520 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:42.521 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:42.521 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:42.594 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:42.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:42.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:42.702 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:42.780 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:42.780 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:42.780 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:42.837 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:42.837 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:42.838 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:42.838 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:43.522 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:43.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:43.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:43.631 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:43.706 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:43.706 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:43.706 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:43.763 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:43.763 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:43.763 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:43.763 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:43.838 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:43.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:43.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:43.946 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:44.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:44.019 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:44.019 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:44.076 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:44.076 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:44.076 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:44.077 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:44.765 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:44.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:44.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:44.873 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:44.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:44.948 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:44.948 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:45.006 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:45.006 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:45.006 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:45.006 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:45.077 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:45.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:45.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:45.185 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:45.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:45.278 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:45.278 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:45.335 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:45.335 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:45.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:45.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:46.007 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:46.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:46.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:46.118 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:46.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:46.199 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:46.199 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:46.256 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:46.257 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:46.257 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:46.257 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:46.337 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:46.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:46.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:46.447 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:46.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:46.521 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:46.521 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:46.579 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:46.579 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:46.579 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:46.579 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:47.258 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:47.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:47.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:47.369 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:47.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:47.460 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:47.460 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:47.517 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:47.518 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:47.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:47.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:47.581 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:47.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:47.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:47.691 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:47.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:47.777 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:47.777 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:47.834 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:47.835 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:47.835 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:47.835 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:48.519 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:48.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:48.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:48.628 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:48.708 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:48.708 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:48.709 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:48.766 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:48.766 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:48.766 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:48.766 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:48.836 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:48.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:48.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:48.947 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:49.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:49.036 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:49.036 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:49.092 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:49.093 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:49.093 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:49.093 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:49.768 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:49.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:49.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:49.877 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:49.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:49.959 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:49.959 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:50.016 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:50.016 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:50.016 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:50.016 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:50.094 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:50.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:50.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:50.203 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:50.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:50.277 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:50.277 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:50.334 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:50.335 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:50.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:50.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:51.017 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:51.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:51.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:51.126 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:51.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:51.199 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:51.199 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:51.256 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:51.256 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:51.257 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:51.257 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:51.337 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:51.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:51.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:51.446 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:51.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:51.527 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:51.527 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:51.585 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:51.585 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:51.585 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:51.585 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:52.258 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:52.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:52.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:52.368 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:52.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:52.459 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:52.459 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:52.515 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:52.515 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:52.516 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:52.516 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:52.587 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:52.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:52.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:52.695 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:52.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:52.771 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:52.771 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:52.828 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:52.828 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:52.828 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:52.828 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:53.517 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:53.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:53.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:53.626 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:53.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:53.709 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:53.709 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:53.767 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:53.767 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:53.767 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:53.767 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:53.829 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:53.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:53.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:53.938 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:54.011 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:54.011 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:54.011 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:54.069 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:54.069 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:54.069 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:54.069 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:54.769 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:54.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:54.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:54.876 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:54.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:54.959 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:54.959 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:55.016 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:55.016 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:55.017 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:55.017 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:55.070 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:55.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:55.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:55.178 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:55.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:55.258 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:55.258 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:55.315 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:55.315 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:55.315 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:55.315 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:56.018 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:56.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:56.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:56.127 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:56.203 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:56.203 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:56.203 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:56.259 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:56.260 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:56.260 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:56.260 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:56.317 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:56.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:56.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:56.425 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:56.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:56.508 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:56.508 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:56.565 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:56.566 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:56.566 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:56.566 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:57.261 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:57.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:57.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:57.370 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:57.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:57.449 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:57.449 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:57.508 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:57.508 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:57.508 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:57.508 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:57.567 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:57.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:57.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:57.675 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:57.757 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:57.757 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:57.757 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:57.814 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:57.814 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:57.814 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:57.814 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:58.509 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:58.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:58.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:58.618 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:58.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:58.702 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:58.703 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:15:58.759 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:58.760 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:58.760 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:58.760 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:58.816 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:58.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:58.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:58.938 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:15:59.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:15:59.013 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:59.013 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:15:59.070 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:59.070 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:59.070 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:59.070 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:59.761 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:59.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:59.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:59.869 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:15:59.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:15:59.946 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:59.946 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:00.003 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:00.004 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:00.004 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:00.004 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:00.071 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:00.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:00.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:00.180 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:00.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:00.256 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:00.256 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:00.313 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:00.313 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:00.313 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:00.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:01.006 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:01.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:01.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:01.116 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:01.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:01.199 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:01.199 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:01.255 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:01.256 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:01.256 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:01.256 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:01.315 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:01.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:01.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:01.424 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:01.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:01.500 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:01.500 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:01.558 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:01.558 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:01.558 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:01.558 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:02.257 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:02.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:02.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:02.366 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:02.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:02.455 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:02.455 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:02.513 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:02.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:02.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:02.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:02.559 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:02.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:02.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:02.667 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:02.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:02.753 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:02.753 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:02.811 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:02.811 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:02.811 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:02.812 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:03.514 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:03.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:03.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:03.624 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:03.703 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:03.703 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:03.704 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:03.761 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:03.761 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:03.761 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:03.762 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:03.812 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:03.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:03.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:03.922 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:04.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:04.002 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:04.002 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:04.060 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:04.060 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:04.060 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:04.060 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:04.763 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:04.763 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:04.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:04.871 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:04.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:04.949 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:04.949 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:05.005 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:05.006 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:05.006 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:05.006 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:05.062 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:05.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:05.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:05.170 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:05.248 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:05.249 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:05.249 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:05.306 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:05.306 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:05.306 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:05.306 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:06.007 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:06.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:06.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:06.115 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:06.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:06.192 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:06.192 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:06.250 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:06.251 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:06.251 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:06.251 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:06.308 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:06.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:06.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:06.416 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:06.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:06.496 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:06.496 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:06.553 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:06.554 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:06.554 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:06.554 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:07.252 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:07.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:07.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:07.362 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:07.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:07.440 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:07.440 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:07.496 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:07.497 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:07.497 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:07.497 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:07.555 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:07.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:07.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:07.663 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:07.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:07.734 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:07.734 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:07.792 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:07.792 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:07.792 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:07.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:08.498 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:08.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:08.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:08.607 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:08.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:08.695 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:08.695 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:08.752 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:08.753 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:08.753 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:08.753 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:08.794 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:08.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:08.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:08.902 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:08.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:08.986 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:08.986 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:09.044 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:09.044 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:09.044 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:09.044 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:09.754 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:09.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:09.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:09.862 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:09.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:09.938 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:09.938 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:09.994 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:09.994 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:09.994 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:09.994 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:10.045 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:10.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:10.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:10.146 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:10.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:10.225 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:10.225 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:10.282 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:10.283 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:10.283 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:10.283 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:10.995 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:10.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:10.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:11.103 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:11.179 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:11.180 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:11.180 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:11.237 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:11.237 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:11.237 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:11.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:11.284 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:11.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:11.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:11.393 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:11.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:11.472 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:11.473 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:11.530 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:11.531 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:11.531 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:11.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:12.239 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:12.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:12.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:12.348 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:12.429 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:12.429 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:12.429 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:12.486 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:12.487 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:12.487 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:12.487 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:12.532 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:12.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:12.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:12.639 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:12.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:12.727 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:12.727 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:12.784 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:12.784 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:12.785 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:12.785 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:13.489 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:13.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:13.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:13.598 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:13.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:13.681 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:13.681 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:13.738 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:13.739 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:13.739 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:13.739 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:13.786 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:13.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:13.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:13.894 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:13.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:13.979 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:13.979 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:14.037 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:14.037 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:14.038 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:14.038 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:14.740 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:14.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:14.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:14.850 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:14.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:14.926 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:14.926 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:14.984 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:14.984 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:14.985 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:14.985 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:15.039 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:15.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:15.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:15.147 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:15.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:15.230 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:15.230 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:15.287 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:15.287 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:15.287 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:15.287 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:15.986 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:15.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:15.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:16.095 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:16.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:16.171 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:16.171 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:16.230 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:16.230 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:16.230 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:16.230 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:16.288 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:16.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:16.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:16.397 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:16.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:16.471 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:16.471 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:16.528 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:16.528 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:16.528 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:16.529 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:17.232 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:17.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:17.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:17.340 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:17.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:17.422 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:17.422 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:17.478 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:17.479 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:17.479 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:17.479 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:17.530 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:17.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:17.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:17.637 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:17.715 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:17.715 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:17.715 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:17.771 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:17.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:17.772 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:17.772 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:18.480 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:18.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:18.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:18.589 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:18.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:18.672 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:18.672 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:18.730 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:18.730 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:18.730 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:18.730 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:18.773 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:18.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:18.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:18.882 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:18.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:18.960 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:18.960 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:19.017 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:19.017 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:19.017 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:19.017 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:19.731 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:19.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:19.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:19.840 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:19.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:19.932 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:19.932 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:19.989 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:19.989 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:19.989 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:19.989 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:20.019 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:20.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:20.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:20.128 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:20.208 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:20.208 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:20.208 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:20.265 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:20.266 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:20.266 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:20.266 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:20.991 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:20.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:20.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:21.100 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:21.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:21.182 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:21.182 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:21.239 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:21.239 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:21.239 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:21.239 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:21.267 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:21.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:21.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:21.375 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:21.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:21.460 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:21.460 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:21.518 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:21.518 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:21.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:21.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:22.240 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:22.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:22.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:22.349 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:22.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:22.423 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:22.423 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:22.481 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:22.482 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:22.482 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:22.482 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:22.520 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:22.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:22.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:22.629 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:22.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:22.705 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:22.705 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:22.762 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:22.762 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:22.762 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:22.763 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:23.483 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:23.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:23.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:23.592 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:23.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:23.674 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:23.674 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:23.731 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:23.732 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:23.732 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:23.732 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:23.764 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:23.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:23.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:23.874 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:23.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:23.958 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:23.958 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:24.014 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:24.015 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:24.015 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:24.015 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:24.733 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:24.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:24.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:24.845 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:24.924 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:24.925 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:24.925 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:24.982 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:24.982 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:24.982 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:24.983 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:25.016 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:25.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:25.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:25.124 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:25.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:25.197 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:25.197 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:25.254 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:25.254 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:25.254 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:25.254 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:25.984 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:25.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:25.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:26.093 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:26.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:26.170 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:26.170 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:26.227 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:26.227 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:26.227 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:26.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:26.256 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:26.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:26.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:26.364 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:26.442 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:26.442 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:26.442 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:26.498 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:26.499 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:26.499 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:26.499 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:27.228 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:27.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:27.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:27.338 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:27.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:27.420 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:27.421 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:27.478 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:27.478 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:27.478 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:27.478 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:27.500 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:27.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:27.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:27.608 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:27.686 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:27.686 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:27.686 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:27.745 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:27.746 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:27.746 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:27.746 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:28.479 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:28.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:28.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:28.588 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:28.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:28.663 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:28.663 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:28.720 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:28.721 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:28.721 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:28.721 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:28.748 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:28.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:28.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:28.855 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:28.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:28.944 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:28.944 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:29.000 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:29.001 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:29.001 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:29.001 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:29.722 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:29.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:29.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:29.831 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:29.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:29.908 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:29.908 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:29.965 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:29.965 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:29.965 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:29.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:30.002 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:30.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:30.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:30.110 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:30.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:30.199 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:30.199 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:30.256 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:30.256 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:30.256 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:30.256 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:30.966 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:30.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:30.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:31.075 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:31.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:31.159 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:31.159 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:31.216 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:31.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:31.216 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:31.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:31.257 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:31.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:31.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:31.365 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:31.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:31.444 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:31.444 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:31.502 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:31.503 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:31.503 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:31.503 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:32.218 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:32.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:32.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:32.326 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:32.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:32.408 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:32.408 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:32.465 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:32.465 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:32.465 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:32.466 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:32.504 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:32.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:32.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:32.613 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:32.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:32.702 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:32.702 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:32.759 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:32.759 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:32.759 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:32.759 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:33.467 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:33.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:33.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:33.544 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:33.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:33.629 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:33.629 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:33.687 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:33.687 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:33.687 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:33.687 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:33.760 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:33.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:33.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:33.869 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:33.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:33.948 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:33.948 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:34.004 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:34.005 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:34.005 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:34.005 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:34.688 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:34.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:34.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:34.759 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:34.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:34.847 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:34.848 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:34.906 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:34.906 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:34.907 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:34.907 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:35.007 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:35.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:35.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:35.115 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:35.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:35.193 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:35.193 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:35.249 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:35.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:35.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:35.250 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:35.908 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:35.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:35.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:36.016 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:36.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:36.097 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:36.098 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:36.155 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:36.155 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:36.155 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:36.155 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:36.250 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:36.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:36.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:36.359 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:36.442 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:36.442 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:36.442 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:36.500 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:36.500 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:36.500 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:36.500 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:37.156 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:37.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:37.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:37.265 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:37.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:37.343 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:37.344 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:37.401 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:37.401 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:37.401 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:37.402 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:37.502 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:37.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:37.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:37.611 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:37.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:37.685 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:37.685 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:37.743 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:37.743 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:37.743 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:37.743 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:38.403 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:38.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:38.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:38.511 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:38.591 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:38.591 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:38.591 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:38.648 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:38.648 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:38.648 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:38.649 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:38.745 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:38.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:38.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:38.853 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:38.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:38.932 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:38.932 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:38.990 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:38.990 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:38.991 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:38.991 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:39.650 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:39.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:39.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:39.759 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:39.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:39.840 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:39.841 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:39.897 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:39.897 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:39.898 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:39.898 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:39.992 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:39.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:39.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:40.101 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:40.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:40.175 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:40.175 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:40.232 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:40.233 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:40.233 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:40.233 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:40.899 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:40.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:40.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:41.008 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:41.088 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:41.088 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:41.088 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:41.145 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:41.145 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:41.145 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:41.145 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:41.234 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:41.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:41.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:41.343 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:41.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:41.418 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:41.418 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:41.475 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:41.475 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:41.475 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:41.476 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:42.147 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:42.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:42.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:42.255 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:42.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:42.326 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:42.327 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:42.383 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:42.383 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:42.384 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:42.384 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:42.477 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:42.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:42.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:42.585 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:42.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:42.659 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:42.660 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:42.718 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:42.719 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:42.719 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:42.719 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:43.385 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:43.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:43.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:43.493 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:43.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:43.565 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:43.565 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:43.622 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:43.622 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:43.622 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:43.622 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:43.720 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:43.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:43.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:43.830 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:43.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:43.902 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:43.902 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:43.960 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:43.960 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:43.960 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:43.960 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:44.624 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:44.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:44.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:44.732 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:44.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:44.814 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:44.814 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:44.871 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:44.872 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:44.872 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:44.872 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:44.961 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:44.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:44.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:45.070 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:45.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:45.149 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:45.149 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:45.207 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:45.207 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:45.207 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:45.208 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:45.874 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:45.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:45.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:45.984 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:46.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:46.063 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:46.063 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:46.121 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:46.121 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:46.121 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:46.121 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:46.208 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:46.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:46.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:46.317 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:46.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:46.392 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:46.393 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:46.450 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:46.450 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:46.450 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:46.451 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:47.123 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:47.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:47.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:47.234 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:47.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:47.309 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:47.309 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:47.366 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:47.367 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:47.367 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:47.367 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:47.452 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:47.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:47.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:47.561 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:47.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:47.637 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:47.637 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:47.694 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:47.695 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:47.695 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:47.695 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:48.369 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:48.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:48.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:48.478 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:48.562 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:48.563 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:48.563 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:48.620 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:48.621 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:48.621 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:48.621 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:48.696 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:48.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:48.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:48.806 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:48.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:48.884 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:48.884 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:48.941 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:48.941 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:48.941 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:48.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:49.622 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:49.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:49.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:49.732 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:49.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:49.816 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:49.816 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:49.874 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:49.874 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:49.874 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:49.874 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:49.942 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:49.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:49.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:50.051 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:50.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:50.132 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:50.132 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:50.189 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:50.190 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:50.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:50.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:50.875 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:50.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:50.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:50.985 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:51.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:51.074 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:51.075 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:51.131 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:51.131 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:51.131 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:51.132 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:51.192 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:51.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:51.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:51.274 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:51.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:51.352 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:51.352 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:51.408 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:51.408 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:51.408 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:51.408 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:52.133 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:52.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:52.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:52.243 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:52.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:52.318 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:52.319 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:52.375 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:52.376 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:52.376 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:52.376 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:52.409 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:52.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:52.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:52.514 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:52.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:52.589 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:52.590 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:52.647 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:52.647 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:52.647 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:52.648 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:53.377 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:53.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:53.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:53.484 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:53.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:53.559 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:53.559 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:53.617 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:53.617 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:53.617 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:53.617 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:53.649 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:53.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:53.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:53.755 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:53.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:53.831 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:53.831 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:53.889 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:53.890 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:53.890 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:53.890 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:54.619 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:54.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:54.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:54.727 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:54.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:54.803 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:54.803 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:54.861 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:54.862 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:54.862 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:54.862 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:54.892 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:54.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:54.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:54.965 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:55.044 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:55.044 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:55.044 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:55.101 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:55.101 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:55.102 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:55.102 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:55.863 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:55.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:55.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:55.973 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:56.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:56.059 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:56.059 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:56.103 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:56.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:56.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:56.199 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:56.199 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:56.199 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:56.199 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:56.210 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:56.287 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:56.287 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:56.287 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:56.345 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:56.345 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:56.345 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:56.346 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:57.200 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:57.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:57.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:57.310 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:57.347 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:57.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:57.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:57.424 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:57.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:57.430 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:57.430 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:57.487 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:57.487 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:57.487 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:57.487 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:57.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:57.512 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:57.512 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:57.569 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:57.569 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:57.569 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:57.569 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:58.488 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:58.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:58.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:58.584 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:58.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:58.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:58.638 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:58.649 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:58.696 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:58.696 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:58.696 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:58.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:58.732 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:58.732 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:16:58.753 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:58.754 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:58.754 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:58.754 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:58.790 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:16:58.790 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:16:58.790 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:16:58.790 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:16:59.754 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:16:59.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:59.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:59.853 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:16:59.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:59.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:16:59.905 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:16:59.915 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:16:59.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:16:59.963 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:59.963 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:16:59.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:16:59.992 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:16:59.992 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:00.019 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:00.020 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:00.020 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:00.020 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:00.048 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:00.048 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:00.048 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:00.048 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:01.021 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:01.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:01.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:01.114 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:01.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:01.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:01.173 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:01.184 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:01.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:01.191 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:01.191 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:01.248 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:01.248 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:01.248 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:01.248 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:01.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:01.259 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:01.259 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:01.317 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:01.317 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:01.318 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:01.318 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:02.249 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:02.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:02.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:02.347 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:02.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:02.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:02.400 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:02.411 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:02.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:02.417 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:02.418 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:02.474 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:02.474 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:02.475 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:02.475 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:02.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:02.483 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:02.483 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:02.541 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:02.541 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:02.541 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:02.541 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:03.475 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:03.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:03.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:03.549 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:03.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:03.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:03.601 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:03.612 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:03.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:03.659 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:03.659 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:03.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:03.682 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:03.682 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:03.715 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:03.716 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:03.716 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:03.716 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:03.741 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:03.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:03.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:03.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:04.717 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:04.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:04.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:04.816 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:04.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:04.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:04.868 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:04.879 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:04.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:04.886 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:04.886 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:04.944 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:04.944 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:04.944 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:04.944 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:04.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:04.951 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:04.951 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:05.007 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:05.008 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:05.008 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:05.008 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:05.945 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:05.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:05.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:06.044 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:06.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:06.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:06.096 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:06.107 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:06.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:06.113 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:06.113 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:06.170 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:06.170 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:06.170 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:06.170 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:06.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:06.184 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:06.184 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:06.241 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:06.242 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:06.242 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:06.242 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:07.171 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:07.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:07.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:07.269 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:07.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:07.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:07.321 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:07.332 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:07.379 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:07.379 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:07.379 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:07.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:07.405 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:07.405 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:07.436 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:07.436 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:07.437 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:07.437 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:07.462 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:07.462 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:07.462 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:07.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:08.438 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:08.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:08.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:08.537 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:08.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:08.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:08.589 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:08.600 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:08.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:08.606 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:08.606 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:08.662 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:08.662 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:08.663 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:08.663 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:08.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:08.685 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:08.685 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:08.742 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:08.743 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:08.743 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:08.743 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:09.664 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:09.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:09.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:09.744 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:09.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:09.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:09.796 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:09.807 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:09.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:09.813 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:09.813 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:09.869 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:09.869 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:09.869 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:09.869 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:09.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:09.880 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:09.880 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:09.937 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:09.938 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:09.938 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:09.938 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:10.870 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:10.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:10.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:10.970 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:10.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:10.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:11.021 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:11.032 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:11.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:11.079 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:11.079 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:11.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:11.113 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:11.113 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:11.137 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:11.137 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:11.137 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:11.137 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:11.170 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:11.171 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:11.171 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:11.171 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:12.138 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:12.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:12.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:12.236 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:12.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:12.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:12.288 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:12.298 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:12.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:12.305 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:12.305 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:12.362 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:12.363 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:12.363 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:12.363 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:12.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:12.383 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:12.383 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:12.441 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:12.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:12.442 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:12.442 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:13.364 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:13.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:13.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:13.463 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:13.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:13.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:13.515 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:13.526 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:13.533 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:13.533 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:13.533 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:13.589 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:13.589 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:13.589 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:13.589 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:13.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:13.611 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:13.611 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:13.669 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:13.669 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:13.669 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:13.669 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:14.590 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:14.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:14.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:14.689 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:14.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:14.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:14.741 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:14.752 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:14.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:14.800 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:14.800 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:14.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:14.840 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:14.840 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:14.856 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:14.857 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:14.857 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:14.857 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:14.897 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:14.898 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:14.898 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:14.898 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:15.858 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:15.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:15.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:15.956 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:15.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:15.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:16.007 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:16.018 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:16.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:16.066 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:16.066 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:16.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:16.093 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:16.093 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:16.124 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:16.124 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:16.124 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:16.124 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:16.150 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:16.150 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:16.151 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:16.151 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:17.125 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:17.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:17.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:17.224 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:17.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:17.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:17.276 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:17.287 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:17.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:17.293 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:17.293 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:17.350 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:17.350 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:17.350 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:17.350 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:17.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:17.361 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:17.361 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:17.419 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:17.419 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:17.419 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:17.419 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:18.351 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:18.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:18.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:18.450 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:18.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:18.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:18.501 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:18.512 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:18.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:18.560 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:18.560 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:18.591 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:18.592 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:18.592 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:18.616 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:18.616 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:18.617 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:18.617 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:18.649 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:18.649 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:18.649 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:18.649 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:19.618 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:19.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:19.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:19.719 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:19.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:19.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:19.771 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:19.782 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:19.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:19.829 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:19.829 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:19.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:19.870 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:19.870 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:19.887 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:19.887 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:19.887 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:19.887 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:19.928 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:19.929 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:19.929 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:19.929 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:20.889 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:20.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:20.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:20.988 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:20.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:20.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:21.040 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:21.051 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:21.058 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:21.058 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:21.058 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:21.115 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:21.115 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:21.115 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:21.115 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:21.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:21.131 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:21.131 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:21.188 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:21.189 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:21.189 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:21.189 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:22.116 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:22.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:22.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:22.214 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:22.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:22.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:22.267 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:22.277 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:22.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:22.285 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:22.285 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:22.342 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:22.342 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:22.342 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:22.342 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:22.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:22.352 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:22.352 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:22.410 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:22.411 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:22.411 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:22.411 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:23.343 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:23.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:23.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:23.442 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:23.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:23.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:23.493 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:23.504 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:23.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:23.551 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:23.551 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:23.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:23.578 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:23.578 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:23.608 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:23.609 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:23.609 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:23.609 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:23.635 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:23.635 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:23.635 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:23.636 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:24.610 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:24.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:24.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:24.708 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:24.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:24.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:24.760 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:24.771 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:24.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:24.777 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:24.778 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:24.833 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:24.833 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:24.833 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:24.833 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:24.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:24.846 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:24.846 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:24.903 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:24.904 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:24.904 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:24.904 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:25.834 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:25.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:25.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:25.932 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:25.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:25.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:25.984 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:25.995 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:26.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:26.002 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:26.002 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:26.059 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:26.059 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:26.059 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:26.059 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:26.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:26.076 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:26.076 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:26.133 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:26.133 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:26.133 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:26.133 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:27.061 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:27.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:27.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:27.159 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:27.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:27.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:27.212 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:27.222 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:27.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:27.229 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:27.229 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:27.285 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:27.286 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:27.286 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:27.286 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:27.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:27.299 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:27.299 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:27.358 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:27.358 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:27.358 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:27.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:28.286 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:28.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:28.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:28.386 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:28.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:28.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:28.438 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:28.449 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:28.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:28.496 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:28.496 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:28.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:28.527 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:28.527 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:28.553 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:28.553 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:28.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:28.553 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:28.584 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:28.584 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:28.584 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:28.584 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:29.555 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:29.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:29.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:29.652 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:29.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:29.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:29.704 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:29.715 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:29.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:29.763 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:29.764 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:29.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:29.785 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:29.785 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:29.821 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:29.821 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:29.821 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:29.821 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:29.842 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:29.842 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:29.842 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:29.843 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:30.822 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:30.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:30.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:30.921 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:30.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:30.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:30.973 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:30.984 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:30.991 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:30.991 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:30.991 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:31.048 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:31.048 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:31.048 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:31.048 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:31.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:31.060 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:31.060 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:31.117 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:31.118 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:31.118 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:31.118 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:32.049 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:32.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:32.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:32.147 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:32.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:32.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:32.199 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:32.210 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:32.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:32.257 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:32.257 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:32.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:32.285 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:32.285 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:32.314 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:32.315 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:32.315 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:32.315 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:32.342 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:32.342 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:32.342 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:32.342 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:33.316 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:33.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:33.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:33.413 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:33.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:33.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:33.464 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:33.475 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:33.522 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:33.522 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:33.522 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:33.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:33.560 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:33.560 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:33.579 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:33.579 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:33.579 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:33.579 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:33.617 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:33.617 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:33.617 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:33.617 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:34.580 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:34.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:34.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:34.679 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:34.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:34.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:34.731 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:34.742 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:34.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:34.748 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:34.748 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:34.807 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:34.807 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:34.807 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:34.807 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:34.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:34.833 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:34.833 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:34.890 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:34.891 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:34.891 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:34.891 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:35.808 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:35.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:35.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:35.905 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:35.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:35.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:35.958 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:35.969 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:35.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:35.975 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:35.975 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:36.031 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:36.031 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:36.031 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:36.031 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:36.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:36.052 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:36.052 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:36.109 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:36.109 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:36.109 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:36.109 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:37.033 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:37.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:37.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:37.130 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:37.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:37.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:37.182 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:37.193 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:37.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:37.241 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:37.241 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:37.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:37.272 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:37.272 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:37.298 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:37.298 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:37.298 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:37.298 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:37.330 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:37.330 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:37.330 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:37.330 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:38.299 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:38.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:38.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:38.398 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:38.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:38.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:38.450 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:38.461 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:38.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:38.508 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:38.508 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:38.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:38.535 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:38.535 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:38.565 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:38.565 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:38.565 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:38.565 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:38.591 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:38.591 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:38.591 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:38.591 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:39.566 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:39.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:39.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:39.665 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:39.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:39.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:39.717 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:39.728 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:39.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:39.775 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:39.776 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:39.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:39.803 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:39.803 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:39.833 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:39.833 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:39.833 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:39.833 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:39.862 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:39.862 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:39.862 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:39.862 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:40.834 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:40.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:40.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:40.933 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:40.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:40.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:40.986 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:40.996 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:41.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:41.045 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:41.045 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:41.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:41.086 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:41.086 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:41.103 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:41.103 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:41.103 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:41.103 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:41.143 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:41.143 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:41.143 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:41.143 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:42.105 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:42.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:42.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:42.203 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:42.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:42.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:42.255 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:42.266 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:42.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:42.272 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:42.272 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:42.331 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:42.331 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:42.331 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:42.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:42.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:42.355 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:42.355 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:42.411 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:42.412 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:42.412 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:42.412 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:43.332 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:43.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:43.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:43.430 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:43.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:43.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:43.483 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:43.494 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:43.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:43.543 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:43.543 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:43.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:43.569 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:43.569 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:43.599 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:43.600 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:43.600 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:43.600 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:43.625 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:43.626 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:43.626 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:43.626 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:44.600 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:44.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:44.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:44.699 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:44.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:44.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:44.751 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:44.762 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:44.769 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:44.769 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:44.769 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:44.825 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:44.825 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:44.825 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:44.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:44.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:44.841 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:44.841 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:44.898 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:44.898 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:44.898 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:44.898 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:45.826 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:45.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:45.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:45.924 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:45.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:45.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:45.976 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:45.987 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:46.033 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:46.033 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:46.033 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:46.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:46.066 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:46.066 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:46.090 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:46.090 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:46.090 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:46.090 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:46.123 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:46.124 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:46.124 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:46.124 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:47.092 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:47.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:47.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:47.190 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:47.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:47.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:47.243 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:47.254 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:47.260 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:47.261 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:47.261 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:47.317 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:47.318 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:47.318 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:47.318 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:47.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:47.326 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:47.326 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:47.385 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:47.385 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:47.385 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:47.385 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:48.319 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:48.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:48.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:48.416 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:48.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:48.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:48.469 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:48.480 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:48.486 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:48.486 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:48.486 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:48.542 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:48.543 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:48.543 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:48.543 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:48.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:48.569 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:48.569 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:48.626 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:48.627 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:48.627 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:48.627 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:49.545 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:49.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:49.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:49.643 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:49.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:49.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:49.695 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:49.706 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:49.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:49.712 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:49.712 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:49.768 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:49.768 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:49.768 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:49.768 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:49.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:49.779 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:49.779 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:49.836 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:49.836 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:49.836 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:49.836 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:50.769 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:50.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:50.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:50.867 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:50.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:50.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:50.919 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:50.930 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:50.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:50.977 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:50.977 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:51.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:51.006 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:51.006 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:51.033 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:51.033 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:51.033 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:51.033 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:51.065 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:51.065 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:51.065 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:51.065 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:52.035 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:52.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:52.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:52.133 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:52.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:52.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:52.185 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:52.196 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:52.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:52.244 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:52.244 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:52.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:52.281 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:52.281 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:52.302 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:52.302 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:52.302 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:52.302 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:52.338 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:52.338 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:52.338 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:52.338 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:53.303 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:53.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:53.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:53.401 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:53.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:53.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:53.453 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:53.464 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:53.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:53.471 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:53.471 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:53.527 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:53.527 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:53.527 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:53.527 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:53.540 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:53.540 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:53.540 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:53.598 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:53.598 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:53.598 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:53.598 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:54.528 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:54.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:54.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:54.626 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:54.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:54.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:54.677 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:54.688 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:54.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:54.734 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:54.735 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:54.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:54.764 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:54.764 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:54.790 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:54.791 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:54.791 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:54.791 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:54.820 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:54.821 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:54.821 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:54.821 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:55.792 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:55.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:55.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:55.890 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:55.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:55.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:55.942 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:55.953 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:55.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:55.959 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:55.959 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:56.015 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:56.016 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:56.016 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:56.016 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:56.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:56.034 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:56.035 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:56.092 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:56.092 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:56.093 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:56.093 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:57.017 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:57.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:57.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:57.115 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:57.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:57.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:57.166 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:57.177 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:57.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:57.226 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:57.226 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:57.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:57.252 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:57.252 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:57.283 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:57.283 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:57.283 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:57.283 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:57.310 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:57.310 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:57.310 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:57.310 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:58.285 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:58.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:58.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:58.384 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:58.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:58.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:58.437 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:58.448 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:58.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:58.454 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:58.454 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:58.513 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:58.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:58.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:58.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:58.526 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:58.526 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:58.526 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:58.583 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:58.583 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:58.583 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:58.583 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:59.514 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:17:59.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:59.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:59.615 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:17:59.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:59.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:17:59.668 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:17:59.678 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:17:59.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:17:59.685 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:59.685 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:17:59.741 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:59.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:59.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:59.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:17:59.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:17:59.752 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:17:59.752 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:17:59.811 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:17:59.811 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:17:59.812 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:17:59.812 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:00.742 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:00.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:00.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:00.842 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:00.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:00.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:00.894 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:00.905 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:00.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:00.953 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:00.953 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:00.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:00.984 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:00.984 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:01.011 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:01.011 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:01.011 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:01.011 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:01.042 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:01.042 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:01.042 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:01.043 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:02.012 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:02.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:02.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:02.111 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:02.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:02.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:02.163 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:02.173 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:02.222 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:02.222 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:02.222 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:02.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:02.250 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:02.250 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:02.279 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:02.279 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:02.279 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:02.279 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:02.306 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:02.307 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:02.307 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:02.307 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:03.280 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:03.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:03.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:03.379 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:03.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:03.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:03.431 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:03.442 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:03.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:03.488 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:03.488 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:03.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:03.518 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:03.518 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:03.546 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:03.546 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:03.546 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:03.546 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:03.575 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:03.575 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:03.575 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:03.575 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:04.547 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:04.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:04.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:04.646 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:04.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:04.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:04.699 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:04.710 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:04.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:04.716 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:04.716 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:04.772 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:04.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:04.773 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:04.773 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:04.799 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:04.799 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:04.800 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:04.858 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:04.858 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:04.858 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:04.859 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:05.774 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:05.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:05.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:05.874 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:05.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:05.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:05.927 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:05.938 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:05.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:05.944 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:05.944 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:06.000 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:06.000 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:06.000 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:06.001 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:06.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:06.014 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:06.014 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:06.071 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:06.071 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:06.072 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:06.072 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:07.002 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:07.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:07.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:07.100 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:07.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:07.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:07.153 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:07.164 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:07.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:07.170 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:07.170 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:07.226 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:07.226 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:07.227 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:07.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:07.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:07.245 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:07.245 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:07.304 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:07.304 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:07.304 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:07.305 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:08.227 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:08.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:08.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:08.326 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:08.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:08.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:08.378 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:08.389 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:08.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:08.396 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:08.396 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:08.452 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:08.452 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:08.453 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:08.453 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:08.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:08.464 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:08.464 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:08.521 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:08.522 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:08.522 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:08.522 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:09.453 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:09.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:09.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:09.553 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:09.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:09.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:09.606 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:09.617 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:09.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:09.623 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:09.623 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:09.679 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:09.679 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:09.679 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:09.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:09.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:09.695 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:09.695 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:09.753 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:09.753 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:09.753 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:09.753 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:10.680 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:10.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:10.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:10.778 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:10.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:10.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:10.830 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:10.841 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:10.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:10.888 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:10.888 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:10.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:10.914 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:10.914 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:10.946 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:10.946 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:10.946 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:10.946 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:10.970 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:10.971 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:10.971 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:10.971 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:11.947 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:11.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:11.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:12.046 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:12.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:12.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:12.097 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:12.108 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:12.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:12.156 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:12.156 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:12.188 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:12.188 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:12.189 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:12.213 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:12.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:12.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:12.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:12.247 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:12.247 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:12.247 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:12.248 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:13.214 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:13.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:13.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:13.314 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:13.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:13.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:13.366 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:13.376 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:13.424 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:13.425 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:13.425 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:13.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:13.449 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:13.449 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:13.482 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:13.482 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:13.482 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:13.482 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:13.507 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:13.507 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:13.507 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:13.507 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:14.482 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:14.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:14.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:14.533 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:14.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:14.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:14.584 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:14.595 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:14.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:14.642 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:14.642 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:14.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:14.669 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:14.669 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:14.698 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:14.698 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:14.698 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:14.698 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:14.725 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:14.726 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:14.726 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:14.726 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:15.699 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:15.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:15.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:15.779 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:15.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:15.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:15.849 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:15.859 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:15.866 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:15.866 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:15.866 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:15.923 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:15.923 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:15.923 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:15.923 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:15.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:15.931 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:15.931 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:15.988 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:15.989 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:15.989 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:15.989 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:16.923 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:16.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:16.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:17.023 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:17.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:17.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:17.075 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:17.085 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:17.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:17.092 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:17.092 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:17.149 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:17.149 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:17.149 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:17.149 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:17.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:17.171 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:17.171 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:17.228 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:17.229 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:17.229 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:17.229 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:18.149 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:18.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:18.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:18.248 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:18.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:18.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:18.301 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:18.311 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:18.360 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:18.360 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:18.360 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:18.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:18.381 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:18.381 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:18.417 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:18.417 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:18.417 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:18.417 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:18.438 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:18.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:18.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:18.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:19.418 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:19.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:19.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:19.517 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:19.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:19.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:19.569 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:19.580 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:19.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:19.627 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:19.627 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:19.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:19.650 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:19.650 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:19.684 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:19.684 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:19.685 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:19.685 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:19.708 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:19.708 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:19.708 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:19.708 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:20.686 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:20.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:20.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:20.783 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:20.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:20.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:20.834 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:20.845 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:20.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:20.890 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:20.890 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:20.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:20.918 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:20.918 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:20.947 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:20.947 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:20.947 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:20.947 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:20.974 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:20.974 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:20.974 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:20.974 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:21.948 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:21.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:21.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:22.049 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:22.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:22.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:22.103 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:22.113 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:22.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:22.120 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:22.120 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:22.177 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:22.177 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:22.177 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:22.177 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:22.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:22.190 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:22.190 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:22.247 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:22.247 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:22.248 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:22.248 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:23.178 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:23.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:23.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:23.277 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:23.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:23.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:23.329 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:23.340 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:23.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:23.348 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:23.349 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:23.405 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:23.405 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:23.405 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:23.405 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:23.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:23.418 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:23.418 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:23.474 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:23.475 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:23.475 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:23.475 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:24.407 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:24.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:24.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:24.505 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:24.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:24.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:24.557 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:24.568 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:24.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:24.616 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:24.616 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:24.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:24.645 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:24.645 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:24.673 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:24.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:24.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:24.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:24.703 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:24.703 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:24.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:24.703 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:25.675 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:25.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:25.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:25.773 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:25.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:25.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:25.825 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:25.836 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:25.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:25.842 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:25.842 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:25.900 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:25.900 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:25.900 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:25.900 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:25.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:25.907 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:25.908 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:25.965 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:25.965 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:25.965 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:25.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:26.901 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:26.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:26.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:27.006 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:27.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:27.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:27.058 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:27.069 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:27.117 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:27.117 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:27.118 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:27.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:27.144 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:27.144 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:27.175 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:27.175 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:27.175 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:27.176 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:27.201 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:27.202 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:27.202 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:27.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:28.176 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:28.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:28.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:28.275 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:28.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:28.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:28.326 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:28.337 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:28.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:28.384 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:28.384 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:28.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:28.412 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:28.412 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:28.441 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:28.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:28.441 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:28.441 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:28.469 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:28.469 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:28.469 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:28.469 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:29.443 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:29.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:29.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:29.544 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:29.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:29.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:29.596 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:29.607 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:29.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:29.613 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:29.613 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:29.669 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:29.669 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:29.669 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:29.669 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:29.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:29.690 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:29.691 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:29.747 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:29.748 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:29.748 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:29.748 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:30.670 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:30.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:30.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:30.774 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:30.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:30.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:30.826 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:30.837 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:30.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:30.885 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:30.885 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:30.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:30.914 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:30.914 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:30.942 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:30.942 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:30.942 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:30.942 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:30.971 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:30.971 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:30.971 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:30.971 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:31.943 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:31.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:31.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:32.042 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:32.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:32.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:32.095 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:32.105 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:32.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:32.112 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:32.112 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:32.169 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:32.169 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:32.169 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:32.169 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:32.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:32.180 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:32.180 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:32.238 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:32.238 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:32.238 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:32.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:33.170 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:33.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:33.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:33.269 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:33.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:33.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:33.320 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:33.331 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:33.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:33.338 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:33.338 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:33.395 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:33.395 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:33.395 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:33.395 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:33.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:33.410 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:33.410 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:33.466 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:33.466 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:33.466 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:33.466 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:34.396 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:34.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:34.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:34.463 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:34.466 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:34.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:34.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:34.530 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:34.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:34.536 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:34.536 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:34.593 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:34.594 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:34.594 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:34.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:34.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:34.615 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:34.615 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:34.672 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:34.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:34.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:34.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:35.595 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:35.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:35.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:35.694 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:35.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:35.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:35.746 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:35.757 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:35.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:35.806 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:35.806 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:35.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:35.837 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:35.837 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:35.862 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:35.863 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:35.863 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:35.863 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:35.894 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:35.894 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:35.894 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:35.894 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:36.864 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:36.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:36.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:36.962 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:36.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:36.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:37.014 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:37.025 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:37.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:37.032 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:37.032 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:37.089 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:37.090 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:37.090 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:37.090 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:37.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:37.100 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:37.100 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:37.157 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:37.158 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:37.158 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:37.158 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:38.091 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:38.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:38.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:38.190 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:38.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:38.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:38.243 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:38.253 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:38.260 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:38.260 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:38.260 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:38.318 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:38.318 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:38.318 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:38.319 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:38.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:38.330 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:38.330 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:38.388 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:38.388 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:38.388 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:38.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:39.320 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:39.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:39.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:39.381 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:39.390 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:39.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:39.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:39.451 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:39.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:39.459 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:39.459 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:39.515 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:39.515 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:39.515 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:39.515 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:39.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:39.532 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:39.532 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:39.590 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:39.590 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:39.590 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:39.590 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:40.516 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:40.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:40.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:40.577 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:40.590 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:40.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:40.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:40.652 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:40.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:40.659 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:40.659 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:40.715 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:40.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:40.715 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:40.715 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:40.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:40.742 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:40.742 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:40.799 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:40.800 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:40.800 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:40.800 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:41.716 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:41.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:41.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:41.813 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:41.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:41.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:41.865 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:41.876 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:41.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:41.923 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:41.923 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:41.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:41.955 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:41.955 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:41.980 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:41.980 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:41.980 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:41.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:42.012 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:42.012 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:42.012 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:42.012 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:42.981 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:42.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:42.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:43.079 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:43.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:43.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:43.131 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:43.142 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:43.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:43.190 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:43.190 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:43.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:43.215 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:43.215 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:43.247 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:43.248 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:43.248 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:43.248 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:43.272 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:43.272 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:43.272 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:43.272 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:44.249 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:44.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:44.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:44.347 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:44.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:44.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:44.399 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:44.409 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:44.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:44.457 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:44.457 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:44.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:44.487 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:44.487 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:44.513 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:44.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:44.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:44.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:44.544 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:44.544 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:44.544 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:44.544 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:45.514 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:45.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:45.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:45.612 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:45.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:45.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:45.665 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:45.675 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:45.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:45.682 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:45.682 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:45.740 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:45.740 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:45.740 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:45.740 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:45.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:45.749 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:45.749 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:45.808 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:45.808 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:45.808 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:45.809 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:46.741 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:46.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:46.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:46.842 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:46.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:46.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:46.894 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:46.905 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:46.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:46.952 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:46.952 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:46.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:46.980 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:46.980 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:47.010 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:47.010 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:47.010 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:47.010 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:47.038 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:47.038 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:47.038 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:47.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:48.011 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:48.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:48.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:48.109 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:48.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:48.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:48.161 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:48.171 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:48.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:48.219 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:48.219 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:48.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:48.254 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:48.254 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:48.276 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:48.276 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:48.276 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:48.277 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:48.312 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:48.312 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:48.312 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:48.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:49.278 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:49.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:49.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:49.377 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:49.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:49.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:49.428 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:49.439 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:49.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:49.446 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:49.446 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:49.502 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:49.502 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:49.502 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:49.502 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:49.511 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:49.511 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:49.511 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:49.569 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:49.569 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:49.569 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:49.569 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:50.503 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:50.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:50.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:50.601 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:50.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:50.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:50.654 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:50.664 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:50.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:50.671 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:50.671 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:50.727 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:50.727 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:50.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:50.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:50.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:50.736 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:50.736 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:50.792 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:50.793 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:50.793 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:50.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:51.728 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:51.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:51.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:51.828 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:51.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:51.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:51.880 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:51.891 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:51.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:51.898 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:51.898 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:51.954 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:51.954 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:51.954 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:51.954 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:51.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:51.961 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:51.961 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:52.019 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:52.019 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:52.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:52.019 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:52.955 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:52.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:52.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:53.054 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:53.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:53.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:53.106 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:53.117 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:53.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:53.165 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:53.165 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:53.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:53.189 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:53.189 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:53.222 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:53.223 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:53.223 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:53.223 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:53.247 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:53.247 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:53.247 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:53.247 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:54.225 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:54.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:54.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:54.324 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:54.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:54.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:54.376 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:54.387 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:54.435 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:54.435 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:54.435 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:54.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:54.470 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:54.470 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:54.491 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:54.491 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:54.491 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:54.491 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:54.527 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:54.528 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:54.528 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:54.528 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:55.492 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:55.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:55.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:55.591 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:55.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:55.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:55.643 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:55.654 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:55.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:55.662 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:55.662 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:55.719 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:55.720 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:55.720 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:55.720 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:55.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:55.735 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:55.735 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:55.792 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:55.792 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:55.792 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:55.792 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:56.720 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:56.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:56.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:56.819 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:56.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:56.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:56.871 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:56.882 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:56.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:56.890 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:56.890 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:56.946 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:56.946 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:56.946 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:56.946 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:56.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:56.960 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:56.961 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:57.018 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:57.018 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:57.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:57.019 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:57.947 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:57.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:57.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:58.046 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:58.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:58.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:58.099 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:58.110 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:58.117 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:58.117 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:58.117 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:58.174 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:58.174 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:58.174 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:58.174 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:58.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:58.191 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:58.191 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:58.247 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:58.248 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:58.248 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:58.248 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:59.175 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:18:59.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:59.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:59.273 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:18:59.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:59.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:18:59.325 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:18:59.336 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:18:59.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:18:59.343 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:59.343 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:18:59.399 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:59.400 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:59.400 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:59.400 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:18:59.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:18:59.414 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:18:59.414 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:18:59.470 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:18:59.470 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:18:59.470 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:18:59.470 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:00.401 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:00.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:00.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:00.482 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:00.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:00.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:00.532 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:00.543 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:00.591 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:00.591 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:00.591 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:00.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:00.628 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:00.628 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:00.648 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:00.649 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:00.649 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:00.649 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:00.685 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:00.686 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:00.686 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:00.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:01.650 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:01.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:01.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:01.749 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:01.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:01.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:01.801 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:01.812 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:01.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:01.818 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:01.819 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:01.875 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:01.876 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:01.876 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:01.876 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:01.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:01.891 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:01.891 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:01.947 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:01.947 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:01.947 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:01.947 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:02.877 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:02.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:02.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:02.975 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:02.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:02.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:03.028 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:03.038 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:03.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:03.045 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:03.045 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:03.101 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:03.101 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:03.102 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:03.102 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:03.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:03.118 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:03.118 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:03.176 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:03.176 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:03.176 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:03.176 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:04.103 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:04.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:04.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:04.201 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:04.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:04.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:04.253 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:04.264 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:04.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:04.312 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:04.312 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:04.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:04.339 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:04.339 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:04.369 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:04.369 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:04.369 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:04.369 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:04.396 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:04.396 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:04.396 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:04.396 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:05.370 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:05.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:05.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:05.469 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:05.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:05.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:05.522 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:05.533 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:05.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:05.539 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:05.539 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:05.595 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:05.596 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:05.596 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:05.596 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:05.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:05.623 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:05.623 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:05.680 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:05.680 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:05.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:05.681 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:06.597 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:06.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:06.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:06.695 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:06.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:06.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:06.748 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:06.759 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:06.765 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:06.765 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:06.765 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:06.822 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:06.822 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:06.822 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:06.822 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:06.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:06.835 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:06.835 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:06.892 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:06.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:06.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:06.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:07.823 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:07.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:07.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:07.921 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:07.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:07.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:07.990 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:08.002 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:08.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:08.009 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:08.009 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:08.066 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:08.066 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:08.066 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:08.066 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:08.088 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:08.088 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:08.088 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:08.145 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:08.145 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:08.145 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:08.145 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:09.067 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:09.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:09.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:09.168 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:09.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:09.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:09.220 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:09.231 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:09.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:09.279 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:09.279 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:09.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:09.305 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:09.305 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:09.335 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:09.336 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:09.336 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:09.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:09.362 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:09.362 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:09.362 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:09.362 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:10.337 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:10.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:10.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:10.435 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:10.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:10.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:10.488 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:10.499 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:10.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:10.506 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:10.506 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:10.562 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:10.562 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:10.562 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:10.562 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:10.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:10.574 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:10.574 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:10.631 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:10.632 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:10.632 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:10.632 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:11.564 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:11.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:11.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:11.663 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:11.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:11.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:11.715 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:11.726 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:11.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:11.732 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:11.733 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:11.789 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:11.790 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:11.790 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:11.790 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:11.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:11.802 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:11.802 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:11.859 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:11.859 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:11.859 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:11.859 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:12.791 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:12.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:12.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:12.890 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:12.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:12.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:12.943 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:12.954 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:12.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:12.960 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:12.960 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:13.018 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:13.018 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:13.018 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:13.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:13.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:13.041 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:13.041 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:13.098 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:13.098 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:13.099 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:13.099 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:14.019 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:14.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:14.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:14.118 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:14.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:14.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:14.171 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:14.182 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:14.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:14.189 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:14.189 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:14.245 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:14.245 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:14.245 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:14.245 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:14.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:14.256 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:14.256 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:14.314 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:14.314 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:14.314 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:14.314 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:15.246 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:15.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:15.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:15.345 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:15.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:15.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:15.398 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:15.408 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:15.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:15.456 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:15.456 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:15.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:15.491 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:15.491 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:15.513 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:15.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:15.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:15.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:15.547 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:15.548 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:15.548 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:15.548 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:16.514 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:16.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:16.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:16.612 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:16.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:16.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:16.665 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:16.676 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:16.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:16.682 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:16.682 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:16.739 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:16.739 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:16.739 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:16.739 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:16.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:16.751 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:16.751 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:16.808 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:16.808 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:16.808 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:16.809 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:17.740 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:17.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:17.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:17.837 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:17.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:17.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:17.890 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:17.901 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:17.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:17.948 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:17.948 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:17.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:17.986 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:17.986 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:18.005 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:18.006 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:18.006 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:18.006 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:18.044 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:18.044 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:18.044 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:18.044 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:19.006 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:19.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:19.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:19.107 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:19.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:19.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:19.159 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:19.170 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:19.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:19.177 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:19.177 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:19.234 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:19.234 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:19.234 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:19.234 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:19.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:19.243 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:19.243 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:19.300 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:19.300 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:19.300 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:19.300 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:20.235 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:20.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:20.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:20.333 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:20.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:20.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:20.385 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:20.396 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:20.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:20.402 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:20.402 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:20.458 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:20.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:20.458 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:20.458 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:20.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:20.472 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:20.472 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:20.529 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:20.529 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:20.529 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:20.529 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:21.459 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:21.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:21.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:21.556 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:21.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:21.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:21.608 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:21.619 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:21.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:21.625 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:21.626 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:21.683 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:21.683 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:21.683 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:21.683 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:21.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:21.698 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:21.698 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:21.755 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:21.756 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:21.756 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:21.756 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:22.683 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:22.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:22.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:22.783 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:22.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:22.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:22.835 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:22.846 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:22.893 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:22.893 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:22.893 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:22.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:22.922 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:22.922 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:22.950 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:22.950 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:22.950 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:22.950 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:22.979 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:22.979 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:22.979 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:22.979 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:23.951 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:23.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:23.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:24.050 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:24.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:24.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:24.129 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:24.140 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:24.148 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:24.148 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:24.148 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:24.205 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:24.205 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:24.205 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:24.205 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:24.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:24.220 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:24.220 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:24.277 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:24.277 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:24.277 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:24.277 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:25.206 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:25.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:25.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:25.324 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:25.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:25.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:25.336 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:25.393 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:25.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:25.418 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:25.418 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:25.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:25.466 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:25.466 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:25.475 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:25.475 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:25.475 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:25.475 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:25.524 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:25.524 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:25.524 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:25.524 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:26.476 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:26.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:26.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:26.575 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:26.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:26.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:26.627 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:26.638 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:26.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:26.683 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:26.683 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:26.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:26.710 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:26.710 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:26.740 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:26.740 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:26.740 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:26.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:26.768 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:26.768 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:26.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:26.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:27.742 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:27.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:27.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:27.842 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:27.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:27.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:27.894 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:27.905 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:27.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:27.953 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:27.953 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:27.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:27.986 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:27.986 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:28.009 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:28.010 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:28.010 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:28.010 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:28.043 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:28.043 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:28.043 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:28.044 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:29.011 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:29.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:29.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:29.109 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:29.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:29.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:29.161 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:29.172 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:29.179 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:29.179 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:29.179 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:29.236 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:29.236 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:29.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:29.236 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:29.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:29.249 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:29.249 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:29.306 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:29.306 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:29.307 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:29.307 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:30.237 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:30.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:30.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:30.335 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:30.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:30.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:30.387 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:30.398 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:30.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:30.404 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:30.404 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:30.461 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:30.461 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:30.461 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:30.461 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:30.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:30.484 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:30.484 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:30.541 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:30.542 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:30.542 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:30.542 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:31.462 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:31.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:31.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:31.560 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:31.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:31.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:31.613 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:31.623 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:31.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:31.630 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:31.630 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:31.688 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:31.689 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:31.689 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:31.689 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:31.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:31.711 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:31.711 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:31.768 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:31.768 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:31.768 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:31.768 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:32.690 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:32.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:32.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:32.789 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:32.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:32.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:32.841 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:32.852 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:32.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:32.899 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:32.899 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:32.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:32.935 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:32.935 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:32.956 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:32.956 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:32.956 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:32.956 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:32.992 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:32.992 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:32.992 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:32.993 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:33.957 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:33.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:33.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:34.055 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:34.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:34.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:34.107 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:34.118 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:34.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:34.165 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:34.165 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:34.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:34.199 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:34.199 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:34.222 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:34.222 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:34.222 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:34.222 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:34.257 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:34.258 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:34.258 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:34.258 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:35.224 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:35.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:35.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:35.321 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:35.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:35.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:35.373 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:35.384 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:35.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:35.390 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:35.390 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:35.447 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:35.447 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:35.447 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:35.447 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:35.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:35.471 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:35.471 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:35.528 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:35.528 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:35.528 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:35.528 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:36.448 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:36.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:36.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:36.547 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:36.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:36.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:36.599 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:36.610 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:36.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:36.658 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:36.658 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:36.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:36.686 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:36.686 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:36.715 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:36.716 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:36.716 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:36.716 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:36.744 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:36.744 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:36.744 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:36.745 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:37.717 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:37.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:37.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:37.816 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:37.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:37.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:37.868 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:37.879 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:37.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:37.928 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:37.929 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:37.957 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:37.957 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:37.957 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:37.985 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:37.985 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:37.985 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:37.985 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:38.013 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:38.013 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:38.013 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:38.013 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:38.986 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:38.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:38.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:39.083 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:39.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:39.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:39.136 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:39.147 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:39.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:39.153 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:39.153 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:39.211 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:39.212 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:39.212 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:39.212 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:39.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:39.219 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:39.219 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:39.276 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:39.276 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:39.276 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:39.276 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:40.213 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:40.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:40.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:40.274 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:40.278 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:40.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:40.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:40.342 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:40.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:40.351 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:40.351 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:40.407 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:40.407 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:40.407 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:40.407 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:40.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:40.423 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:40.423 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:40.480 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:40.480 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:40.481 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:40.481 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:41.408 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:41.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:41.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:41.516 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:41.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:41.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:41.585 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:41.597 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:41.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:41.604 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:41.604 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:41.661 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:41.661 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:41.661 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:41.661 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:41.676 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:41.677 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:41.677 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:41.734 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:41.734 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:41.734 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:41.734 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:42.662 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:42.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:42.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:42.723 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:42.735 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:42.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:42.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:42.797 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:42.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:42.803 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:42.803 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:42.861 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:42.862 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:42.862 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:42.862 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:42.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:42.874 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:42.874 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:42.931 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:42.931 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:42.931 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:42.931 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:43.863 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:43.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:43.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:43.961 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:43.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:43.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:44.013 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:44.024 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:44.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:44.031 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:44.031 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:44.087 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:44.087 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:44.087 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:44.087 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:44.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:44.100 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:44.100 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:44.157 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:44.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:44.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:44.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:45.088 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:45.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:45.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:45.187 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:45.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:45.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:45.239 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:45.250 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:45.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:45.297 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:45.297 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:45.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:45.328 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:45.328 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:45.354 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:45.354 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:45.355 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:45.355 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:45.385 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:45.385 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:45.385 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:45.385 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:46.356 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:46.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:46.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:46.454 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:46.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:46.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:46.506 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:46.517 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:46.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:46.523 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:46.523 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:46.580 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:46.580 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:46.580 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:46.580 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:46.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:46.595 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:46.595 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:46.652 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:46.652 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:46.653 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:46.653 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:47.581 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:47.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:47.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:47.674 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:47.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:47.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:47.726 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:47.737 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:47.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:47.743 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:47.743 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:47.800 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:47.800 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:47.800 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:47.800 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:47.812 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:47.812 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:47.812 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:47.868 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:47.869 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:47.869 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:47.869 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:48.801 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:48.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:48.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:48.900 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:48.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:48.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:48.953 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:48.963 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:48.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:48.970 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:48.970 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:49.027 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:49.027 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:49.027 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:49.027 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:49.039 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:49.039 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:49.040 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:49.098 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:49.099 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:49.099 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:49.099 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:50.028 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:50.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:50.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:50.127 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:50.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:50.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:50.180 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:50.191 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:50.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:50.198 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:50.198 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:50.255 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:50.256 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:50.256 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:50.256 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:50.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:50.271 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:50.271 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:50.329 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:50.329 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:50.329 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:50.329 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:51.257 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:51.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:51.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:51.356 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:51.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:51.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:51.408 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:51.419 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:51.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:51.426 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:51.426 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:51.482 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:51.482 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:51.482 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:51.482 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:51.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:51.503 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:51.503 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:51.560 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:51.561 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:51.561 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:51.561 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:52.483 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:52.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:52.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:52.583 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:52.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:52.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:52.636 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:52.646 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:52.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:52.653 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:52.653 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:52.710 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:52.710 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:52.710 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:52.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:52.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:52.726 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:52.726 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:52.783 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:52.784 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:52.784 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:52.784 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:53.711 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:53.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:53.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:53.809 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:53.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:53.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:53.861 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:53.872 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:53.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:53.920 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:53.920 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:53.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:53.961 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:53.961 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:53.977 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:53.977 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:53.977 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:53.977 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:54.019 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:54.019 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:54.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:54.020 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:54.978 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:54.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:54.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:55.076 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:55.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:55.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:55.128 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:55.139 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:55.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:55.146 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:55.146 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:55.203 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:55.203 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:55.203 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:55.203 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:55.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:55.220 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:55.220 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:55.277 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:55.277 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:55.278 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:55.278 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:56.204 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:56.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:56.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:56.303 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:56.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:56.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:56.355 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:56.366 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:56.373 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:56.373 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:56.373 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:56.430 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:56.430 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:56.431 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:56.431 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:56.439 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:56.439 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:56.439 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:56.496 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:56.497 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:56.497 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:56.497 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:57.431 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:57.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:57.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:57.530 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:57.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:57.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:57.582 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:57.593 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:57.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:57.640 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:57.640 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:57.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:57.668 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:57.668 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:57.696 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:57.696 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:57.696 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:57.696 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:57.725 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:57.725 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:57.725 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:57.725 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:58.697 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:58.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:58.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:58.747 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:19:58.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:58.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:19:58.798 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:19:58.809 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:19:58.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:58.856 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:58.856 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:19:58.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:19:58.886 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:19:58.886 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:19:58.913 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:58.913 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:58.913 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:58.913 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:58.943 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:19:58.944 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:19:58.944 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:19:58.944 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:19:59.914 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:19:59.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:19:59.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:00.013 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:20:00.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:00.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:00.064 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:20:00.075 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:20:00.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:00.122 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:00.122 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:20:00.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:00.153 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:00.153 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:20:00.178 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:00.178 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:00.178 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:00.179 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:00.210 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:00.210 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:00.210 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:00.210 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:01.180 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:20:01.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:01.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:01.231 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:20:01.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:01.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:01.282 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:20:01.293 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:20:01.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:01.340 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:01.341 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:20:01.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:01.370 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:01.370 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:20:01.397 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:01.397 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:01.397 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:01.397 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:01.426 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:01.427 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:01.427 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:01.427 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:02.398 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:20:02.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:02.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:02.449 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:20:02.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:02.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:02.501 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:20:02.511 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:20:02.558 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:02.558 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:02.559 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:20:02.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:02.588 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:02.588 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:20:02.615 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:02.615 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:02.615 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:02.615 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:02.644 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:02.645 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:02.645 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:02.645 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:03.616 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:20:03.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:03.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:03.715 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:20:03.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:03.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:03.767 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:20:03.777 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:20:03.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:03.825 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:03.826 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:20:03.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:03.862 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:03.862 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:20:03.884 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:03.884 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:03.884 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:03.884 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:03.920 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:03.920 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:03.920 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:03.920 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:04.885 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:20:04.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:04.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:04.987 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:20:04.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:04.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:05.039 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:20:05.050 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:20:05.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:05.056 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:05.057 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:20:05.114 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:05.114 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:05.114 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:05.114 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:05.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:05.126 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:05.126 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:20:05.183 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:05.184 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:05.184 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:05.184 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:06.115 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:20:06.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:06.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:06.215 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:20:06.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:06.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:06.266 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:20:06.277 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:20:06.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:06.323 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:06.323 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:20:06.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:06.363 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:06.363 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:20:06.380 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:06.381 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:06.381 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:06.381 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:06.420 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:06.421 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:06.421 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:06.421 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:07.381 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:20:07.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:07.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:07.475 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:20:07.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:07.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:07.526 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:20:07.537 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:20:07.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:07.584 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:07.584 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:20:07.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:07.616 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:07.616 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:20:07.640 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:07.640 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:07.640 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:07.640 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:07.673 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:07.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:07.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:07.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:08.640 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:20:08.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:08.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:08.739 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:20:08.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:08.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:08.792 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:20:08.803 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:20:08.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:08.809 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:08.810 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:20:08.866 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:08.867 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:08.867 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:08.867 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:08.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:08.889 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:08.889 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:20:08.946 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:08.946 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:08.947 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:08.947 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:09.868 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:20:09.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:09.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:09.929 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:20:09.948 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:20:09.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:09.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:10.010 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:20:10.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:10.015 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:10.015 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:20:10.072 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:10.072 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:10.072 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:10.072 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:10.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:10.089 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:10.089 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:20:10.146 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:10.147 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:10.147 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:10.147 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:11.073 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:20:11.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:11.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:11.172 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:20:11.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:11.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:11.224 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:20:11.235 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:20:11.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:11.241 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:11.241 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:20:11.299 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:11.299 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:11.299 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:11.299 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:11.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:11.309 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:11.309 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:20:11.366 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:11.366 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:11.367 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:11.367 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:12.300 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:20:12.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:12.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:12.398 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:20:12.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:12.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:12.451 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:20:12.461 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:20:12.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:12.468 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:12.468 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:20:12.524 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:12.524 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:12.524 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:12.524 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:12.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:12.537 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:12.537 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:20:12.595 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:12.595 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:12.595 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:12.595 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:13.525 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:20:13.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:13.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:13.624 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:20:13.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:13.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:13.676 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:20:13.687 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:20:13.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:13.693 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:13.693 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:20:13.751 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:13.751 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:13.751 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:13.751 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:13.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:13.765 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:13.765 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:20:13.821 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:13.822 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:13.822 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:13.822 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:14.752 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:20:14.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:14.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:14.851 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:20:14.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:14.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:14.903 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:20:14.914 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:20:14.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:14.921 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:14.921 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:20:14.977 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:14.977 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:14.977 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:14.977 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:14.996 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:14.996 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:14.997 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:20:15.054 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:15.055 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:15.055 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:15.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:15.978 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:20:15.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:15.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:16.078 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:20:16.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:16.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:16.130 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:20:16.141 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:20:16.147 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:16.148 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:16.148 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:20:16.204 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:16.204 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:16.204 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:16.205 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:16.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:16.221 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:16.221 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:20:16.278 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:16.279 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:16.279 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:16.279 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:17.206 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:20:17.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:17.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:17.305 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:20:17.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:17.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:20:17.357 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-12T22:20:17.368 DEBUG:teuthology.orchestra.run.trial180:> true 2026-02-12T22:20:17.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-12T22:20:17.416 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:17.416 DEBUG:teuthology.orchestra.run.trial133:> uname -r 2026-02-12T22:20:17.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial180.front.sepia.ceph.com' 2026-02-12T22:20:17.445 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:20:17.445 DEBUG:teuthology.orchestra.run.trial180:> uname -r 2026-02-12T22:20:17.473 INFO:teuthology.orchestra.run.trial133.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:17.473 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:17.473 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:17.473 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:17.473 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:17.474 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:20:17.486 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:20:17.513 INFO:teuthology.run:Summary data: description: fs/32bits/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_pjd} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:20:17.514 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:20:17.560 INFO:teuthology.orchestra.run.trial180.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:20:17.560 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:20:17.560 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:20:17.560 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:20:17.597 INFO:teuthology.run:FAIL