2026-02-12T22:47:48.429 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:47:48.445 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:47:48.525 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47303 branch: wip-pdonnell-testing-20260210.171210 description: fs/snaps/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-1c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/workunit/snaps} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47303' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds use global snaprealm seq for subvol: false mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFkAxr/H68MVYa8zsSb4xejbHmHn6gmXDyXLHvOwpoQvgbmn8CuP4a5KgvnmMaQ/x+DUbbg0tgGj3y58OqdQC2c= trial193.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBZ8PMdHjYe9vrneT9hzE0qgHvWUtTgQ+Lrb60gjdPymgFgnac5dOzgW3cGKBMazjoMA1v1Ut/Om1aKG4PvE26I= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - ceph-fuse: null - workunit: clients: all: - fs/snaps timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:47:48.525 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:47:48.526 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:47:48.526 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:47:48.527 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:47:48.527 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:47:48.527 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:47:48.527 INFO:teuthology.packaging:ref: None 2026-02-12T22:47:48.527 INFO:teuthology.packaging:tag: None 2026-02-12T22:47:48.527 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:47:48.527 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:47:48.527 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:47:48.647 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:47:48.649 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:47:48.666 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:47:48.666 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:47:48.677 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:47:48.685 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:47:48.697 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:47:48.771 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial131.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47303', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:44:24.912271', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFkAxr/H68MVYa8zsSb4xejbHmHn6gmXDyXLHvOwpoQvgbmn8CuP4a5KgvnmMaQ/x+DUbbg0tgGj3y58OqdQC2c='} 2026-02-12T22:47:48.826 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial193.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47303', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:44:24.911612', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBZ8PMdHjYe9vrneT9hzE0qgHvWUtTgQ+Lrb60gjdPymgFgnac5dOzgW3cGKBMazjoMA1v1Ut/Om1aKG4PvE26I='} 2026-02-12T22:47:48.826 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:47:48.838 INFO:teuthology.task.internal:roles: ubuntu@trial131.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-12T22:47:48.838 INFO:teuthology.task.internal:roles: ubuntu@trial193.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2026-02-12T22:47:48.838 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:47:48.987 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7d018a7e3420>, signals=[15]) 2026-02-12T22:47:48.987 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:47:48.998 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:47:48.998 DEBUG:teuthology.task.internal:connecting to ubuntu@trial131.front.sepia.ceph.com 2026-02-12T22:47:48.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:49.059 DEBUG:teuthology.task.internal:connecting to ubuntu@trial193.front.sepia.ceph.com 2026-02-12T22:47:49.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:49.121 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:47:49.132 DEBUG:teuthology.orchestra.run.trial131:> uname -m 2026-02-12T22:47:49.149 INFO:teuthology.orchestra.run.trial131.stdout:x86_64 2026-02-12T22:47:49.149 DEBUG:teuthology.orchestra.run.trial131:> cat /etc/os-release 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:NAME="Rocky Linux" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:ID="rocky" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:VERSION_ID="10.1" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:ANSI_COLOR="0;32" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:VENDOR_NAME="RESF" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:47:49.206 INFO:teuthology.orchestra.run.trial131.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:47:49.207 INFO:teuthology.orchestra.run.trial131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:47:49.207 INFO:teuthology.lock.ops:Updating trial131.front.sepia.ceph.com on lock server 2026-02-12T22:47:49.265 DEBUG:teuthology.orchestra.run.trial193:> uname -m 2026-02-12T22:47:49.281 INFO:teuthology.orchestra.run.trial193.stdout:x86_64 2026-02-12T22:47:49.281 DEBUG:teuthology.orchestra.run.trial193:> cat /etc/os-release 2026-02-12T22:47:49.338 INFO:teuthology.orchestra.run.trial193.stdout:NAME="Rocky Linux" 2026-02-12T22:47:49.338 INFO:teuthology.orchestra.run.trial193.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:47:49.338 INFO:teuthology.orchestra.run.trial193.stdout:ID="rocky" 2026-02-12T22:47:49.338 INFO:teuthology.orchestra.run.trial193.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:47:49.338 INFO:teuthology.orchestra.run.trial193.stdout:VERSION_ID="10.1" 2026-02-12T22:47:49.338 INFO:teuthology.orchestra.run.trial193.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:47:49.338 INFO:teuthology.orchestra.run.trial193.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:47:49.338 INFO:teuthology.orchestra.run.trial193.stdout:ANSI_COLOR="0;32" 2026-02-12T22:47:49.338 INFO:teuthology.orchestra.run.trial193.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:47:49.338 INFO:teuthology.orchestra.run.trial193.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:47:49.338 INFO:teuthology.orchestra.run.trial193.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:47:49.338 INFO:teuthology.orchestra.run.trial193.stdout:VENDOR_NAME="RESF" 2026-02-12T22:47:49.338 INFO:teuthology.orchestra.run.trial193.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:47:49.338 INFO:teuthology.orchestra.run.trial193.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:47:49.339 INFO:teuthology.orchestra.run.trial193.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:47:49.339 INFO:teuthology.orchestra.run.trial193.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:47:49.339 INFO:teuthology.orchestra.run.trial193.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:47:49.339 INFO:teuthology.orchestra.run.trial193.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:47:49.339 INFO:teuthology.orchestra.run.trial193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:47:49.339 INFO:teuthology.lock.ops:Updating trial193.front.sepia.ceph.com on lock server 2026-02-12T22:47:49.415 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:47:49.428 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:47:49.438 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:47:49.438 DEBUG:teuthology.orchestra.run.trial131:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:47:49.440 DEBUG:teuthology.orchestra.run.trial193:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:47:49.456 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:47:49.467 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:47:49.467 DEBUG:teuthology.orchestra.run.trial131:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:47:49.496 DEBUG:teuthology.orchestra.run.trial193:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:47:49.512 INFO:teuthology.orchestra.run.trial131.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:47:49.514 INFO:teuthology.orchestra.run.trial193.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:47:49.514 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:47:49.671 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:47:49.689 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:47:49.690 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:47:49.690 DEBUG:teuthology.orchestra.run.trial131:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:47:49.690 DEBUG:teuthology.orchestra.run.trial193:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:47:49.706 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:47:49.706 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:47:49.706 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:47:49.707 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:47:49.763 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:49.764 INFO:teuthology.task.kernel:Running kernel on trial131: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:49.764 DEBUG:teuthology.orchestra.run.trial131:> sudo yum install -y kernel 2026-02-12T22:47:49.764 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:49.764 INFO:teuthology.task.kernel:Running kernel on trial193: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:49.764 DEBUG:teuthology.orchestra.run.trial193:> sudo yum install -y kernel 2026-02-12T22:47:50.269 INFO:teuthology.orchestra.run.trial193.stdout:Rocky Linux 10 - AppStream 21 MB/s | 2.2 MB 00:00 2026-02-12T22:47:50.270 INFO:teuthology.orchestra.run.trial131.stdout:Rocky Linux 10 - AppStream 21 MB/s | 2.2 MB 00:00 2026-02-12T22:47:50.603 INFO:teuthology.orchestra.run.trial131.stdout:Rocky Linux 10 - BaseOS 53 MB/s | 11 MB 00:00 2026-02-12T22:47:50.608 INFO:teuthology.orchestra.run.trial193.stdout:Rocky Linux 10 - BaseOS 52 MB/s | 11 MB 00:00 2026-02-12T22:47:51.081 INFO:teuthology.orchestra.run.trial131.stdout:Rocky Linux 10 - CRB 6.5 MB/s | 507 kB 00:00 2026-02-12T22:47:51.093 INFO:teuthology.orchestra.run.trial193.stdout:Rocky Linux 10 - CRB 6.5 MB/s | 507 kB 00:00 2026-02-12T22:47:51.687 INFO:teuthology.orchestra.run.trial193.stdout:Extra Packages for Enterprise Linux 11 MB/s | 6.2 MB 00:00 2026-02-12T22:47:51.734 INFO:teuthology.orchestra.run.trial131.stdout:Extra Packages for Enterprise Linux 10 MB/s | 6.2 MB 00:00 2026-02-12T22:47:52.381 INFO:teuthology.orchestra.run.trial193.stdout:lab-extras 70 kB/s | 3.7 kB 00:00 2026-02-12T22:47:52.392 INFO:teuthology.orchestra.run.trial131.stdout:lab-extras 301 kB/s | 3.7 kB 00:00 2026-02-12T22:47:52.792 INFO:teuthology.orchestra.run.trial193.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:47:52.801 INFO:teuthology.orchestra.run.trial131.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:47:52.804 INFO:teuthology.orchestra.run.trial193.stdout:Dependencies resolved. 2026-02-12T22:47:52.805 INFO:teuthology.orchestra.run.trial193.stdout:================================================================================ 2026-02-12T22:47:52.805 INFO:teuthology.orchestra.run.trial193.stdout: Package Arch Version Repo Size 2026-02-12T22:47:52.805 INFO:teuthology.orchestra.run.trial193.stdout:================================================================================ 2026-02-12T22:47:52.806 INFO:teuthology.orchestra.run.trial193.stdout:Installing: 2026-02-12T22:47:52.806 INFO:teuthology.orchestra.run.trial193.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:47:52.806 INFO:teuthology.orchestra.run.trial193.stdout:Installing dependencies: 2026-02-12T22:47:52.806 INFO:teuthology.orchestra.run.trial193.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:47:52.806 INFO:teuthology.orchestra.run.trial193.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:47:52.806 INFO:teuthology.orchestra.run.trial193.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:47:52.806 INFO:teuthology.orchestra.run.trial193.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:47:52.806 INFO:teuthology.orchestra.run.trial193.stdout: 2026-02-12T22:47:52.806 INFO:teuthology.orchestra.run.trial193.stdout:Transaction Summary 2026-02-12T22:47:52.807 INFO:teuthology.orchestra.run.trial193.stdout:================================================================================ 2026-02-12T22:47:52.807 INFO:teuthology.orchestra.run.trial193.stdout:Install 5 Packages 2026-02-12T22:47:52.807 INFO:teuthology.orchestra.run.trial193.stdout: 2026-02-12T22:47:52.807 INFO:teuthology.orchestra.run.trial193.stdout:Total download size: 93 M 2026-02-12T22:47:52.807 INFO:teuthology.orchestra.run.trial193.stdout:Installed size: 135 M 2026-02-12T22:47:52.807 INFO:teuthology.orchestra.run.trial193.stdout:Downloading Packages: 2026-02-12T22:47:52.813 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T22:47:52.813 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T22:47:52.813 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repo Size 2026-02-12T22:47:52.813 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T22:47:52.814 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-12T22:47:52.814 INFO:teuthology.orchestra.run.trial131.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:47:52.814 INFO:teuthology.orchestra.run.trial131.stdout:Installing dependencies: 2026-02-12T22:47:52.814 INFO:teuthology.orchestra.run.trial131.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:47:52.814 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:47:52.814 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:47:52.814 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:47:52.814 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T22:47:52.814 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-12T22:47:52.814 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T22:47:52.815 INFO:teuthology.orchestra.run.trial131.stdout:Install 5 Packages 2026-02-12T22:47:52.815 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T22:47:52.815 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 93 M 2026-02-12T22:47:52.815 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 135 M 2026-02-12T22:47:52.816 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-12T22:47:52.853 INFO:teuthology.orchestra.run.trial193.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 30 MB/s | 1.4 MB 00:00 2026-02-12T22:47:52.871 INFO:teuthology.orchestra.run.trial131.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 25 MB/s | 1.4 MB 00:00 2026-02-12T22:47:53.061 INFO:teuthology.orchestra.run.trial131.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 75 MB/s | 18 MB 00:00 2026-02-12T22:47:53.068 INFO:teuthology.orchestra.run.trial193.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 70 MB/s | 18 MB 00:00 2026-02-12T22:47:53.116 INFO:teuthology.orchestra.run.trial193.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 58 MB/s | 2.8 MB 00:00 2026-02-12T22:47:53.204 INFO:teuthology.orchestra.run.trial193.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 84 MB/s | 30 MB 00:00 2026-02-12T22:47:53.332 INFO:teuthology.orchestra.run.trial131.stdout:(3/5): kernel-modules-core-6.12.0-124.31.1.el10 64 MB/s | 30 MB 00:00 2026-02-12T22:47:53.404 INFO:teuthology.orchestra.run.trial193.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 68 MB/s | 41 MB 00:00 2026-02-12T22:47:53.405 INFO:teuthology.orchestra.run.trial193.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:47:53.405 INFO:teuthology.orchestra.run.trial193.stdout:Total 155 MB/s | 93 MB 00:00 2026-02-12T22:47:53.405 INFO:teuthology.orchestra.run.trial193.stdout:Running transaction check 2026-02-12T22:47:53.440 INFO:teuthology.orchestra.run.trial131.stdout:(4/5): kernel-modules-extra-6.12.0-124.31.1.el1 7.4 MB/s | 2.8 MB 00:00 2026-02-12T22:47:53.550 INFO:teuthology.orchestra.run.trial193.stdout:Transaction check succeeded. 2026-02-12T22:47:53.550 INFO:teuthology.orchestra.run.trial193.stdout:Running transaction test 2026-02-12T22:47:53.550 INFO:teuthology.orchestra.run.trial131.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 55 MB/s | 41 MB 00:00 2026-02-12T22:47:53.551 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:47:53.551 INFO:teuthology.orchestra.run.trial131.stdout:Total 126 MB/s | 93 MB 00:00 2026-02-12T22:47:53.551 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-12T22:47:53.697 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-12T22:47:53.697 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-12T22:47:53.951 INFO:teuthology.orchestra.run.trial193.stdout:Transaction test succeeded. 2026-02-12T22:47:53.951 INFO:teuthology.orchestra.run.trial193.stdout:Running transaction 2026-02-12T22:47:54.100 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-12T22:47:54.100 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-12T22:47:54.646 INFO:teuthology.orchestra.run.trial193.stdout: Preparing : 1/1 2026-02-12T22:47:54.794 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-12T22:47:54.847 INFO:teuthology.orchestra.run.trial193.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:47:54.869 INFO:teuthology.orchestra.run.trial193.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:47:54.998 INFO:teuthology.orchestra.run.trial131.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:47:55.019 INFO:teuthology.orchestra.run.trial131.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:47:56.137 INFO:teuthology.orchestra.run.trial193.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:47:56.165 INFO:teuthology.orchestra.run.trial193.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:47:56.266 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:47:56.293 INFO:teuthology.orchestra.run.trial131.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:47:58.015 INFO:teuthology.orchestra.run.trial193.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:47:58.021 INFO:teuthology.orchestra.run.trial193.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:47:58.135 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:47:58.141 INFO:teuthology.orchestra.run.trial131.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:47:59.888 INFO:teuthology.orchestra.run.trial193.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:47:59.897 INFO:teuthology.orchestra.run.trial193.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:00.003 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:48:00.013 INFO:teuthology.orchestra.run.trial131.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:01.760 INFO:teuthology.orchestra.run.trial193.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:01.874 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:35.576 INFO:teuthology.orchestra.run.trial193.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:35.597 INFO:teuthology.orchestra.run.trial193.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:35.605 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:35.629 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:35.831 INFO:teuthology.orchestra.run.trial193.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:35.831 INFO:teuthology.orchestra.run.trial193.stdout: 2026-02-12T22:48:35.831 INFO:teuthology.orchestra.run.trial193.stdout:Installed: 2026-02-12T22:48:35.831 INFO:teuthology.orchestra.run.trial193.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.831 INFO:teuthology.orchestra.run.trial193.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.831 INFO:teuthology.orchestra.run.trial193.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.831 INFO:teuthology.orchestra.run.trial193.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.831 INFO:teuthology.orchestra.run.trial193.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.832 INFO:teuthology.orchestra.run.trial193.stdout: 2026-02-12T22:48:35.832 INFO:teuthology.orchestra.run.trial193.stdout:Complete! 2026-02-12T22:48:35.859 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:35.860 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T22:48:35.860 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-12T22:48:35.860 INFO:teuthology.orchestra.run.trial131.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.860 INFO:teuthology.orchestra.run.trial131.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.860 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.860 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.860 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.860 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T22:48:35.860 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T22:48:35.896 DEBUG:teuthology.orchestra.run.trial193:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:48:35.922 DEBUG:teuthology.orchestra.run.trial131:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:48:35.930 INFO:teuthology.orchestra.run.trial193.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.932 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.932 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.932 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:48:35.932 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:48:35.932 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:48:35.932 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial193.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:48:35.933 DEBUG:teuthology.orchestra.run.trial193:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:48:35.957 INFO:teuthology.orchestra.run.trial131.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.958 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.958 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.958 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:48:35.958 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:48:35.959 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:48:35.959 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial131.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:48:35.959 DEBUG:teuthology.orchestra.run.trial131:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:48:36.005 INFO:teuthology.orchestra.run.trial193.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:36.006 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:36.007 DEBUG:teuthology.orchestra.run.trial193:> sudo rpm -qi grub2-tools 2026-02-12T22:48:36.031 INFO:teuthology.orchestra.run.trial131.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:36.032 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:36.032 DEBUG:teuthology.orchestra.run.trial131:> sudo rpm -qi grub2-tools 2026-02-12T22:48:36.077 INFO:teuthology.orchestra.run.trial193.stdout:Name : grub2-tools 2026-02-12T22:48:36.077 INFO:teuthology.orchestra.run.trial193.stdout:Epoch : 1 2026-02-12T22:48:36.078 INFO:teuthology.orchestra.run.trial193.stdout:Version : 2.12 2026-02-12T22:48:36.078 INFO:teuthology.orchestra.run.trial193.stdout:Release : 29.el10_1 2026-02-12T22:48:36.078 INFO:teuthology.orchestra.run.trial193.stdout:Architecture: x86_64 2026-02-12T22:48:36.078 INFO:teuthology.orchestra.run.trial193.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:48:36.078 INFO:teuthology.orchestra.run.trial193.stdout:Group : Unspecified 2026-02-12T22:48:36.078 INFO:teuthology.orchestra.run.trial193.stdout:Size : 7963769 2026-02-12T22:48:36.078 INFO:teuthology.orchestra.run.trial193.stdout:License : GPL-3.0-or-later 2026-02-12T22:48:36.078 INFO:teuthology.orchestra.run.trial193.stdout:Signature : 2026-02-12T22:48:36.078 INFO:teuthology.orchestra.run.trial193.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:48:36.078 INFO:teuthology.orchestra.run.trial193.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:48:36.078 INFO:teuthology.orchestra.run.trial193.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:48:36.079 INFO:teuthology.orchestra.run.trial193.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:48:36.079 INFO:teuthology.orchestra.run.trial193.stdout:Packager : Release Engineering 2026-02-12T22:48:36.079 INFO:teuthology.orchestra.run.trial193.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:48:36.079 INFO:teuthology.orchestra.run.trial193.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:48:36.079 INFO:teuthology.orchestra.run.trial193.stdout:Summary : Support tools for GRUB. 2026-02-12T22:48:36.079 INFO:teuthology.orchestra.run.trial193.stdout:Description : 2026-02-12T22:48:36.079 INFO:teuthology.orchestra.run.trial193.stdout: 2026-02-12T22:48:36.079 INFO:teuthology.orchestra.run.trial193.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:48:36.079 INFO:teuthology.orchestra.run.trial193.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:48:36.079 INFO:teuthology.orchestra.run.trial193.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:48:36.079 INFO:teuthology.orchestra.run.trial193.stdout:hardware devices. 2026-02-12T22:48:36.080 INFO:teuthology.orchestra.run.trial193.stdout: 2026-02-12T22:48:36.080 INFO:teuthology.orchestra.run.trial193.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:48:36.081 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:48:36.081 INFO:teuthology.task.kernel:Updating grub on trial193 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:36.081 DEBUG:teuthology.orchestra.run.trial193:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:48:36.103 INFO:teuthology.orchestra.run.trial131.stdout:Name : grub2-tools 2026-02-12T22:48:36.103 INFO:teuthology.orchestra.run.trial131.stdout:Epoch : 1 2026-02-12T22:48:36.104 INFO:teuthology.orchestra.run.trial131.stdout:Version : 2.12 2026-02-12T22:48:36.104 INFO:teuthology.orchestra.run.trial131.stdout:Release : 29.el10_1 2026-02-12T22:48:36.104 INFO:teuthology.orchestra.run.trial131.stdout:Architecture: x86_64 2026-02-12T22:48:36.104 INFO:teuthology.orchestra.run.trial131.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:48:36.104 INFO:teuthology.orchestra.run.trial131.stdout:Group : Unspecified 2026-02-12T22:48:36.104 INFO:teuthology.orchestra.run.trial131.stdout:Size : 7963769 2026-02-12T22:48:36.104 INFO:teuthology.orchestra.run.trial131.stdout:License : GPL-3.0-or-later 2026-02-12T22:48:36.104 INFO:teuthology.orchestra.run.trial131.stdout:Signature : 2026-02-12T22:48:36.104 INFO:teuthology.orchestra.run.trial131.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:48:36.104 INFO:teuthology.orchestra.run.trial131.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:48:36.104 INFO:teuthology.orchestra.run.trial131.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:48:36.105 INFO:teuthology.orchestra.run.trial131.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:48:36.105 INFO:teuthology.orchestra.run.trial131.stdout:Packager : Release Engineering 2026-02-12T22:48:36.105 INFO:teuthology.orchestra.run.trial131.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:48:36.105 INFO:teuthology.orchestra.run.trial131.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:48:36.105 INFO:teuthology.orchestra.run.trial131.stdout:Summary : Support tools for GRUB. 2026-02-12T22:48:36.105 INFO:teuthology.orchestra.run.trial131.stdout:Description : 2026-02-12T22:48:36.105 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T22:48:36.105 INFO:teuthology.orchestra.run.trial131.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:48:36.105 INFO:teuthology.orchestra.run.trial131.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:48:36.105 INFO:teuthology.orchestra.run.trial131.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:48:36.105 INFO:teuthology.orchestra.run.trial131.stdout:hardware devices. 2026-02-12T22:48:36.105 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T22:48:36.106 INFO:teuthology.orchestra.run.trial131.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:48:36.107 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:48:36.107 INFO:teuthology.task.kernel:Updating grub on trial131 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:36.107 DEBUG:teuthology.orchestra.run.trial131:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:48:36.146 INFO:teuthology.orchestra.run.trial193.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:48:36.148 DEBUG:teuthology.orchestra.run.trial193:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:48:36.172 INFO:teuthology.orchestra.run.trial131.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:48:36.173 DEBUG:teuthology.orchestra.run.trial131:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:48:36.213 INFO:teuthology.orchestra.run.trial193.stdout:/sbin/grubby 2026-02-12T22:48:36.215 INFO:teuthology.orchestra.run.trial193.stdout:yes 2026-02-12T22:48:36.215 DEBUG:teuthology.orchestra.run.trial193:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:48:36.240 INFO:teuthology.orchestra.run.trial131.stdout:/sbin/grubby 2026-02-12T22:48:36.242 INFO:teuthology.orchestra.run.trial131.stdout:yes 2026-02-12T22:48:36.242 DEBUG:teuthology.orchestra.run.trial131:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:48:36.282 INFO:teuthology.orchestra.run.trial193.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:48:36.283 DEBUG:teuthology.orchestra.run.trial193:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:36.308 INFO:teuthology.orchestra.run.trial131.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:48:36.309 DEBUG:teuthology.orchestra.run.trial131:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:36.359 DEBUG:teuthology.orchestra.run.trial193:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:48:36.385 DEBUG:teuthology.orchestra.run.trial131:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:48:36.470 INFO:teuthology.orchestra.run.trial193.stderr:Generating grub configuration file ... 2026-02-12T22:48:36.495 INFO:teuthology.orchestra.run.trial131.stderr:Generating grub configuration file ... 2026-02-12T22:48:36.647 INFO:teuthology.orchestra.run.trial193.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:48:36.656 INFO:teuthology.orchestra.run.trial193.stderr:done 2026-02-12T22:48:36.658 DEBUG:teuthology.orchestra.run.trial193:> test -d /sys/firmware/efi 2026-02-12T22:48:36.672 INFO:teuthology.orchestra.run.trial131.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:48:36.674 DEBUG:teuthology.orchestra.run.trial193:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:48:36.682 INFO:teuthology.orchestra.run.trial131.stderr:done 2026-02-12T22:48:36.683 DEBUG:teuthology.orchestra.run.trial131:> test -d /sys/firmware/efi 2026-02-12T22:48:36.700 DEBUG:teuthology.orchestra.run.trial131:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:48:36.743 INFO:teuthology.orchestra.run.trial193.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:48:36.743 INFO:teuthology.orchestra.run.trial193.stdout:/boot/efi/EFI/rocky 2026-02-12T22:48:36.744 DEBUG:teuthology.orchestra.run.trial193:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:48:36.772 INFO:teuthology.orchestra.run.trial131.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:48:36.773 INFO:teuthology.orchestra.run.trial131.stdout:/boot/efi/EFI/rocky 2026-02-12T22:48:36.774 DEBUG:teuthology.orchestra.run.trial131:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:48:36.811 INFO:teuthology.orchestra.run.trial193.stdout:no 2026-02-12T22:48:36.811 DEBUG:teuthology.orchestra.run.trial193:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:48:36.842 INFO:teuthology.orchestra.run.trial131.stdout:no 2026-02-12T22:48:36.842 DEBUG:teuthology.orchestra.run.trial131:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:48:36.878 INFO:teuthology.orchestra.run.trial193.stdout:yes 2026-02-12T22:48:36.878 DEBUG:teuthology.orchestra.run.trial193:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:48:36.908 INFO:teuthology.orchestra.run.trial131.stdout:yes 2026-02-12T22:48:36.909 DEBUG:teuthology.orchestra.run.trial131:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:48:36.944 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial193 2026-02-12T22:48:36.944 DEBUG:teuthology.orchestra.run.trial193:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:48:36.975 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial131 2026-02-12T22:48:36.976 DEBUG:teuthology.orchestra.run.trial131:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:48:37.009 INFO:teuthology.orchestra.run.trial193.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:48:37.041 INFO:teuthology.orchestra.run.trial131.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:49:06.987 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:06.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:06.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:07.088 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:07.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:07.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:07.145 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:07.153 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:07.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:07.162 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:07.162 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:07.219 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:07.219 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.219 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:07.219 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:07.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:07.239 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:07.239 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:07.296 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:07.296 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.297 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:07.297 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:08.221 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:08.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:08.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:08.320 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:08.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:08.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:08.373 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:08.382 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:08.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:08.432 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:08.432 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:08.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:08.468 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:08.468 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:08.489 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:08.490 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.490 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:08.490 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:08.525 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:08.525 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.525 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:08.525 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:09.491 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:09.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:09.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:09.589 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:09.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:09.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:09.642 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:09.651 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:09.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:09.700 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:09.701 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:09.721 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:09.721 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:09.721 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:09.756 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:09.756 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:09.756 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:09.756 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:09.779 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:09.780 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:09.780 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:09.780 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:10.757 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:10.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:10.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:10.857 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:10.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:10.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:10.909 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:10.918 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:10.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:10.967 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:10.967 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:11.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:11.003 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:11.003 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:11.024 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:11.024 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:11.024 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:11.024 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:11.059 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:11.060 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:11.060 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:11.060 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:12.024 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:12.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:12.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:12.122 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:12.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:12.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:12.175 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:12.185 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:12.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:12.193 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:12.193 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:12.250 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:12.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:12.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:12.250 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:12.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:12.275 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:12.275 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:12.332 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:12.332 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:12.333 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:12.333 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:13.251 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:13.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:13.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:13.350 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:13.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:13.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:13.401 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:13.411 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:13.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:13.460 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:13.460 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:13.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:13.489 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:13.489 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:13.517 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:13.517 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:13.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:13.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:13.546 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:13.547 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:13.547 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:13.547 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:14.519 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:14.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:14.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:14.617 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:14.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:14.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:14.670 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:14.679 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:14.728 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:14.728 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:14.729 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:14.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:14.753 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:14.754 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:14.786 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:14.786 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:14.786 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:14.786 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:14.810 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:14.810 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:14.810 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:14.810 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:15.787 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:15.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:15.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:15.885 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:15.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:15.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:15.938 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:15.947 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:15.996 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:15.996 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:15.996 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:16.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:16.028 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:16.028 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:16.054 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:16.054 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:16.054 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:16.054 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:16.085 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:16.085 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:16.086 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:16.086 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:17.055 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:17.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:17.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:17.129 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:17.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:17.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:17.180 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:17.190 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:17.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:17.238 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:17.238 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:17.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:17.274 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:17.274 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:17.295 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:17.295 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:17.295 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:17.295 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:17.331 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:17.331 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:17.331 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:17.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:18.296 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:18.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:18.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:18.396 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:18.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:18.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:18.448 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:18.458 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:18.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:18.507 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:18.507 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:18.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:18.532 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:18.533 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:18.564 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:18.564 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:18.564 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:18.564 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:18.589 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:18.590 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:18.590 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:18.590 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:19.565 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:19.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:19.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:19.657 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:19.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:19.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:19.710 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:19.719 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:19.769 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:19.769 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:19.769 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:19.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:19.801 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:19.801 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:19.826 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:19.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:19.826 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:19.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:19.858 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:19.858 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:19.858 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:19.858 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:20.827 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:20.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:20.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:20.927 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:20.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:20.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:20.979 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:20.988 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:21.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:21.038 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:21.038 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:21.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:21.063 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:21.063 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:21.094 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:21.095 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:21.095 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:21.095 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:21.121 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:21.121 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:21.121 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:21.121 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:22.096 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:22.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:22.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:22.194 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:22.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:22.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:22.247 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:22.257 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:22.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:22.305 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:22.306 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:22.332 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:22.332 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:22.332 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:22.362 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:22.362 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:22.362 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:22.362 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:22.389 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:22.390 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:22.390 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:22.390 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:23.363 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:23.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:23.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:23.463 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:23.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:23.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:23.515 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:23.525 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:23.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:23.574 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:23.575 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:23.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:23.599 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:23.599 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:23.631 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:23.631 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:23.631 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:23.631 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:23.656 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:23.656 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:23.656 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:23.656 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:24.632 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:24.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:24.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:24.705 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:24.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:24.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:24.758 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:24.768 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:24.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:24.818 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:24.818 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:24.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:24.842 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:24.843 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:24.876 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:24.876 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:24.876 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:24.876 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:24.899 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:24.899 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:24.899 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:24.899 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:25.876 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:25.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:25.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:25.927 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:25.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:25.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:25.978 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:25.987 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:26.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:26.036 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:26.036 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:26.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:26.067 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:26.067 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:26.092 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:26.093 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:26.093 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:26.093 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:26.125 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:26.126 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:26.126 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:26.126 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:27.094 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:27.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:27.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:27.143 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:27.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:27.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:27.194 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:27.204 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:27.253 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:27.253 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:27.253 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:27.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:27.286 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:27.286 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:27.310 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:27.310 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:27.310 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:27.310 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:27.342 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:27.342 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:27.342 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:27.342 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:28.311 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:28.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:28.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:28.361 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:28.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:28.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:28.411 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:28.420 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:28.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:28.470 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:28.470 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:28.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:28.499 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:28.500 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:28.527 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:28.527 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:28.527 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:28.527 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:28.556 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:28.556 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:28.556 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:28.556 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:29.528 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:29.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:29.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:29.626 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:29.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:29.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:29.678 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:29.688 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:29.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:29.735 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:29.736 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:29.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:29.775 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:29.775 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:29.792 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:29.792 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:29.792 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:29.792 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:29.832 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:29.832 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:29.832 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:29.832 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:30.794 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:30.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:30.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:30.894 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:30.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:30.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:30.946 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:30.956 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:31.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:31.003 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:31.003 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:31.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:31.032 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:31.032 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:31.059 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:31.060 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:31.060 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:31.060 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:31.089 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:31.089 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:31.089 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:31.089 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:32.061 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:32.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:32.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:32.156 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:32.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:32.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:32.186 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:32.241 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:32.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:32.249 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:32.249 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:32.306 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:32.306 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:32.306 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:32.306 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:32.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:32.328 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:32.328 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:32.385 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:32.385 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:32.385 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:32.385 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:33.307 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:33.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:33.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:33.370 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:33.386 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:33.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:33.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:33.446 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:33.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:33.454 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:33.454 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:33.511 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:33.511 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:33.511 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:33.511 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:33.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:33.530 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:33.530 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:33.587 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:33.587 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:33.587 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:33.587 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:34.512 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:34.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:34.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:34.611 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:34.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:34.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:34.666 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:34.676 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:34.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:34.684 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:34.684 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:34.741 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:34.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:34.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:34.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:34.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:34.753 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:34.753 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:34.810 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:34.810 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:34.811 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:34.811 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:35.742 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:35.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:35.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:35.840 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:35.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:35.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:35.892 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:35.902 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:35.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:35.951 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:35.951 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:35.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:35.985 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:35.985 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:36.008 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:36.009 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:36.009 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:36.009 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:36.041 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:36.041 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:36.041 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:36.041 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:37.010 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:37.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:37.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:37.107 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:37.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:37.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:37.158 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:37.168 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:37.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:37.215 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:37.215 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:37.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:37.249 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:37.249 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:37.272 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:37.272 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:37.273 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:37.273 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:37.306 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:37.307 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:37.307 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:37.307 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:38.274 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:38.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:38.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:38.372 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:38.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:38.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:38.424 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:38.433 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:38.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:38.483 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:38.484 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:38.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:38.508 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:38.508 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:38.540 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:38.540 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:38.541 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:38.541 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:38.566 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:38.566 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:38.566 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:38.566 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:39.542 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:39.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:39.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:39.638 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:39.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:39.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:39.699 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:39.709 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:39.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:39.717 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:39.717 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:39.775 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:39.775 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:39.775 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:39.776 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:39.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:39.785 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:39.785 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:39.843 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:39.843 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:39.843 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:39.843 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:40.777 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:40.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:40.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:40.876 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:40.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:40.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:40.928 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:40.938 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:40.988 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:40.988 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:40.988 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:41.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:41.017 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:41.018 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:41.045 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:41.046 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:41.046 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:41.046 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:41.075 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:41.075 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:41.075 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:41.075 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:42.047 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:42.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:42.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:42.138 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:42.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:42.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:42.190 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:42.200 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:42.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:42.250 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:42.250 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:42.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:42.274 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:42.274 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:42.307 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:42.307 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:42.307 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:42.308 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:42.331 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:42.332 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:42.332 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:42.332 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:43.309 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:43.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:43.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:43.401 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:43.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:43.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:43.453 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:43.463 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:43.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:43.512 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:43.512 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:43.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:43.539 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:43.539 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:43.570 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:43.570 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:43.570 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:43.571 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:43.597 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:43.598 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:43.598 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:43.598 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:44.572 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:44.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:44.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:44.670 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:44.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:44.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:44.722 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:44.732 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:44.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:44.783 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:44.783 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:44.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:44.806 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:44.807 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:44.839 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:44.839 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:44.839 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:44.839 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:44.863 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:44.870 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:44.870 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:44.870 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:45.840 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:45.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:45.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:45.938 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:45.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:45.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:45.991 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:46.001 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:46.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:46.050 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:46.050 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:46.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:46.081 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:46.081 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:46.107 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:46.107 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:46.107 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:46.107 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:46.138 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:46.139 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:46.139 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:46.139 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:47.108 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:47.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:47.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:47.203 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:47.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:47.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:47.255 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:47.265 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:47.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:47.314 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:47.314 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:47.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:47.355 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:47.355 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:47.372 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:47.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:47.373 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:47.373 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:47.412 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:47.412 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:47.412 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:47.412 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:48.374 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:48.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:48.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:48.470 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:48.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:48.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:48.523 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:48.532 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:48.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:48.582 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:48.582 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:48.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:48.626 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:48.626 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:48.639 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:48.639 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:48.640 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:48.640 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:48.683 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:48.683 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:48.683 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:48.683 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:49.640 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:49.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:49.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:49.738 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:49.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:49.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:49.790 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:49.800 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:49.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:49.849 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:49.849 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:49.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:49.878 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:49.878 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:49.906 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:49.906 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:49.906 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:49.906 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:49.936 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:49.936 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:49.936 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:49.936 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:50.907 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:50.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:50.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:51.004 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:51.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:51.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:51.069 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:51.080 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:51.088 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:51.088 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:51.088 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:51.145 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:51.145 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:51.145 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:51.145 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:51.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:51.153 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:51.154 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:51.211 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:51.211 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:51.211 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:51.211 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:52.146 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:52.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:52.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:52.244 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:52.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:52.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:52.295 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:52.305 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:52.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:52.352 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:52.352 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:52.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:52.381 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:52.381 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:52.408 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:52.408 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:52.408 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:52.408 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:52.439 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:52.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:52.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:52.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:53.409 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:53.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:53.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:53.507 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:53.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:53.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:53.559 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:53.569 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:53.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:53.619 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:53.619 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:53.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:53.650 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:53.650 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:53.676 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:53.676 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:53.676 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:53.676 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:53.707 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:53.707 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:53.708 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:53.708 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:54.677 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:54.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:54.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:54.775 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:54.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:54.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:54.827 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:54.837 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:54.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:54.886 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:54.886 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:54.909 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:54.909 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:54.909 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:54.943 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:54.944 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:54.944 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:54.944 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:54.967 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:54.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:54.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:54.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:55.945 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:55.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:55.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:56.041 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:56.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:56.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:56.103 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:56.113 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:56.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:56.121 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:56.121 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:56.177 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:56.177 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:56.177 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:56.177 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:56.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:56.201 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:56.201 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:56.259 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:56.260 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:56.260 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:56.260 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:57.179 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:57.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:57.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:57.275 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:57.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:57.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:57.327 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:57.336 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:57.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:57.386 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:57.386 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:57.414 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:57.414 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:57.415 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:57.443 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:57.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:57.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:57.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:57.472 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:57.473 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:57.473 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:57.473 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:58.443 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:58.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:58.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:58.542 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:58.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:58.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:58.593 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:58.603 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:58.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:58.652 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:58.652 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:58.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:58.678 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:58.678 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:58.708 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:58.708 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:58.709 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:58.709 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:58.736 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:58.737 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:58.737 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:58.737 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:59.709 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:59.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:59.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:59.806 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:59.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:59.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:59.858 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:49:59.868 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:49:59.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:49:59.917 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:59.917 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:49:59.956 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:49:59.956 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:59.957 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:49:59.974 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:59.974 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:59.974 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:59.974 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:00.014 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:00.015 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:00.015 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:00.015 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:00.975 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:00.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:00.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:01.074 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:01.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:01.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:01.126 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:01.136 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:01.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:01.186 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:01.186 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:01.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:01.218 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:01.218 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:01.243 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:01.243 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:01.244 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:01.244 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:01.275 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:01.276 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:01.276 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:01.276 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:02.245 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:02.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:02.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:02.345 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:02.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:02.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:02.397 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:02.407 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:02.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:02.456 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:02.456 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:02.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:02.480 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:02.481 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:02.513 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:02.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:02.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:02.514 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:02.538 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:02.538 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:02.538 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:02.538 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:03.515 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:03.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:03.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:03.613 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:03.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:03.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:03.666 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:03.675 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:03.725 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:03.725 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:03.725 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:03.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:03.756 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:03.756 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:03.782 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:03.783 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:03.783 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:03.783 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:03.813 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:03.813 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:03.813 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:03.813 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:04.784 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:04.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:04.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:04.835 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:04.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:04.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:04.887 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:04.896 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:04.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:04.946 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:04.946 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:04.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:04.976 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:04.976 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:05.003 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:05.003 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:05.003 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:05.003 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:05.032 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:05.032 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:05.032 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:05.033 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:06.004 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:06.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:06.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:06.103 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:06.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:06.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:06.155 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:06.165 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:06.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:06.214 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:06.214 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:06.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:06.252 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:06.252 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:06.271 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:06.272 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:06.272 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:06.272 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:06.310 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:06.311 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:06.311 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:06.311 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:07.273 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:07.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:07.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:07.373 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:07.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:07.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:07.431 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:07.441 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:07.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:07.449 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:07.449 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:07.506 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:07.506 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:07.506 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:07.506 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:07.524 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:07.524 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:07.525 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:07.582 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:07.582 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:07.582 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:07.582 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:08.507 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:08.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:08.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:08.607 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:08.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:08.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:08.667 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:08.677 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:08.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:08.685 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:08.685 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:08.742 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:08.742 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:08.742 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:08.742 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:08.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:08.762 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:08.762 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:08.819 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:08.820 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:08.820 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:08.820 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:09.743 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:09.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:09.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:09.809 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:09.821 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:09.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:09.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:09.888 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:09.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:09.896 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:09.896 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:09.954 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:09.954 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:09.954 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:09.954 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:09.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:09.978 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:09.978 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:10.034 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:10.035 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:10.035 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:10.035 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:10.955 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:10.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:10.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:11.054 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:11.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:11.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:11.120 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:11.130 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:11.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:11.137 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:11.137 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:11.194 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:11.195 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:11.195 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:11.195 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:11.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:11.201 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:11.201 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:11.259 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:11.259 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:11.259 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:11.259 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:12.196 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:12.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:12.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:12.296 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:12.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:12.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:12.356 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:12.366 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:12.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:12.374 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:12.374 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:12.431 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:12.432 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:12.432 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:12.432 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:12.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:12.456 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:12.456 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:12.512 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:12.512 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:12.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:12.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:13.433 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:13.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:13.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:13.504 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:13.513 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:13.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:13.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:13.580 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:13.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:13.587 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:13.587 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:13.644 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:13.644 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:13.644 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:13.644 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:13.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:13.660 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:13.660 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:13.717 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:13.718 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:13.718 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:13.718 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:14.645 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:14.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:14.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:14.744 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:14.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:14.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:14.797 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:14.806 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:14.855 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:14.856 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:14.856 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:14.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:14.880 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:14.880 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:14.912 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:14.912 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:14.912 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:14.912 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:14.937 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:14.937 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:14.937 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:14.937 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:15.913 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:15.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:15.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:16.011 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:16.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:16.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:16.077 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:16.087 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:16.095 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:16.095 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:16.095 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:16.153 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:16.153 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:16.153 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:16.153 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:16.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:16.163 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:16.163 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:16.220 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:16.220 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:16.220 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:16.221 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:17.154 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:17.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:17.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:17.253 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:17.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:17.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:17.305 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:17.315 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:17.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:17.364 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:17.364 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:17.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:17.391 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:17.391 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:17.420 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:17.421 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:17.421 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:17.421 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:17.448 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:17.449 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:17.449 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:17.449 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:18.422 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:18.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:18.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:18.520 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:18.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:18.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:18.573 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:18.583 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:18.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:18.631 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:18.631 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:18.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:18.667 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:18.668 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:18.687 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:18.687 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:18.687 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:18.688 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:18.724 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:18.724 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:18.725 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:18.725 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:19.689 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:19.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:19.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:19.788 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:19.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:19.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:19.840 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:19.849 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:19.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:19.900 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:19.900 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:19.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:19.933 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:19.933 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:19.957 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:19.957 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:19.958 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:19.958 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:19.990 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:19.990 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:19.990 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:19.991 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:20.958 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:20.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:20.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:21.057 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:21.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:21.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:21.121 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:21.131 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:21.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:21.140 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:21.140 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:21.196 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:21.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:21.196 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:21.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:21.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:21.215 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:21.215 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:21.273 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:21.273 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:21.273 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:21.273 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:22.197 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:22.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:22.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:22.288 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:22.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:22.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:22.340 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:22.350 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:22.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:22.399 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:22.399 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:22.429 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:22.430 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:22.430 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:22.456 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:22.456 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:22.456 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:22.456 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:22.486 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:22.486 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:22.486 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:22.486 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:23.457 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:23.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:23.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:23.555 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:23.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:23.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:23.607 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:23.617 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:23.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:23.665 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:23.666 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:23.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:23.690 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:23.690 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:23.722 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:23.722 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:23.722 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:23.722 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:23.747 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:23.748 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:23.748 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:23.748 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:24.724 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:24.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:24.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:24.823 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:24.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:24.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:24.875 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:24.885 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:24.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:24.934 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:24.935 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:24.965 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:24.965 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:24.965 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:24.992 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:24.992 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:24.992 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:24.992 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:25.023 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:25.024 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:25.024 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:25.024 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:25.994 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:25.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:25.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:26.094 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:26.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:26.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:26.146 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:26.156 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:26.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:26.204 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:26.205 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:26.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:26.241 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:26.242 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:26.261 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:26.261 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:26.261 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:26.261 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:26.299 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:26.299 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:26.299 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:26.299 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:27.262 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:27.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:27.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:27.359 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:27.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:27.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:27.411 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:27.420 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:27.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:27.470 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:27.470 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:27.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:27.501 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:27.501 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:27.527 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:27.527 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.527 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:27.527 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:27.559 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:27.559 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.559 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:27.560 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:28.527 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:28.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:28.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:28.595 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:28.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:28.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:28.647 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:28.656 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:28.706 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:28.706 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:28.706 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:28.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:28.733 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:28.734 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:28.763 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:28.763 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:28.763 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:28.763 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:28.791 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:28.791 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:28.791 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:28.791 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:29.765 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:29.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:29.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:29.815 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:29.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:29.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:29.866 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:29.876 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:29.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:29.925 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:29.926 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:29.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:29.958 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:29.958 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:29.982 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:29.982 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:29.982 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:29.982 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:30.015 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:30.015 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:30.015 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:30.015 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:30.983 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:30.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:30.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:31.034 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:31.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:31.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:31.085 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:31.095 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:31.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:31.143 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:31.143 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:31.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:31.169 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:31.169 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:31.200 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:31.200 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:31.200 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:31.200 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:31.227 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:31.227 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:31.227 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:31.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:32.201 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:32.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:32.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:32.252 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:32.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:32.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:32.304 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:32.314 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:32.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:32.363 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:32.363 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:32.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:32.387 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:32.387 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:32.419 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:32.420 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:32.420 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:32.420 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:32.443 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:32.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:32.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:32.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:33.420 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:33.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:33.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:33.518 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:33.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:33.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:33.570 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:33.580 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:33.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:33.628 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:33.628 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:33.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:33.658 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:33.658 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:33.685 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:33.686 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:33.686 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:33.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:33.717 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:33.717 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:33.717 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:33.717 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:34.687 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:34.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:34.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:34.784 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:34.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:34.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:34.835 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:34.845 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:34.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:34.894 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:34.894 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:34.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:34.928 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:34.928 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:34.950 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:34.950 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:34.950 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:34.950 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:34.985 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:34.985 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:34.985 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:34.985 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:35.951 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:35.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:35.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:36.050 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:36.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:36.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:36.115 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:36.125 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:36.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:36.132 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:36.133 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:36.189 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:36.190 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:36.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:36.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:36.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:36.201 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:36.201 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:36.259 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:36.259 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:36.260 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:36.260 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:37.191 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:37.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:37.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:37.289 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:37.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:37.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:37.342 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:37.351 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:37.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:37.400 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:37.400 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:37.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:37.431 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:37.431 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:37.457 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:37.457 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:37.457 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:37.457 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:37.488 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:37.489 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:37.489 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:37.489 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:38.458 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:38.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:38.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:38.556 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:38.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:38.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:38.617 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:38.626 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:38.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:38.634 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:38.635 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:38.691 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:38.691 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:38.691 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:38.691 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:38.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:38.705 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:38.705 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:38.763 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:38.763 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:38.763 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:38.763 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:39.692 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:39.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:39.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:39.790 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:39.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:39.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:39.842 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:39.852 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:39.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:39.901 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:39.901 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:39.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:39.930 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:39.930 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:39.958 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:39.958 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:39.958 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:39.958 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:39.987 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:39.987 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:39.987 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:39.987 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:40.959 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:40.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:40.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:41.015 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:41.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:41.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:41.067 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:41.077 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:41.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:41.125 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:41.125 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:41.166 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:41.166 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:41.166 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:41.183 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:41.187 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:41.187 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:41.187 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:41.224 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:41.224 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:41.224 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:41.225 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:42.188 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:42.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:42.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:42.284 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:42.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:42.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:42.335 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:42.345 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:42.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:42.394 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:42.395 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:42.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:42.431 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:42.431 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:42.451 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:42.451 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:42.452 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:42.452 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:42.488 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:42.488 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:42.489 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:42.489 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:43.453 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:43.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:43.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:43.513 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:43.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:43.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:43.565 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:43.575 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:43.621 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:43.621 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:43.621 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:43.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:43.658 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:43.658 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:43.678 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:43.678 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:43.678 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:43.678 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:43.715 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:43.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:43.715 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:43.715 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:44.679 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:44.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:44.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:44.749 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:44.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:44.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:44.801 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:44.810 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:44.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:44.860 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:44.860 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:44.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:44.889 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:44.889 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:44.917 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:44.917 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:44.917 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:44.917 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:44.946 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:44.946 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:44.946 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:44.946 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:45.918 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:45.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:45.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:46.017 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:46.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:46.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:46.068 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:46.078 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:46.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:46.127 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:46.127 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:46.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:46.167 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:46.167 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:46.184 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:46.184 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:46.184 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:46.185 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:46.225 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:46.225 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:46.225 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:46.225 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:47.185 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:47.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:47.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:47.239 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:47.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:47.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:47.291 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:47.300 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:47.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:47.350 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:47.350 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:47.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:47.380 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:47.380 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:47.407 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:47.407 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:47.407 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:47.407 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:47.438 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:47.438 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:47.438 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:47.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:48.407 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:48.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:48.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:48.461 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:48.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:48.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:48.511 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:48.521 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:48.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:48.567 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:48.568 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:48.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:48.597 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:48.597 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:48.624 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:48.624 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:48.624 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:48.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:48.654 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:48.654 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:48.654 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:48.654 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:49.625 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:49.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:49.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:49.723 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:49.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:49.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:49.775 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:49.784 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:49.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:49.833 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:49.833 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:49.859 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:49.859 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:49.859 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:49.890 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:49.891 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:49.891 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:49.891 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:49.917 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:49.917 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:49.917 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:49.917 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:50.892 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:50.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:50.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:50.990 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:50.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:50.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:51.041 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:51.051 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:51.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:51.101 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:51.101 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:51.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:51.127 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:51.127 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:51.159 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:51.159 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:51.159 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:51.159 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:51.185 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:51.185 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:51.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:51.185 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:52.160 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:52.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:52.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:52.210 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:52.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:52.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:52.260 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:52.270 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:52.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:52.319 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:52.320 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:52.342 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:52.342 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:52.343 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:52.376 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:52.376 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:52.376 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:52.376 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:52.399 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:52.399 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:52.399 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:52.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:53.376 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:53.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:53.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:53.476 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:53.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:53.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:53.527 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:53.537 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:53.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:53.587 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:53.587 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:53.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:53.613 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:53.613 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:53.644 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:53.644 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:53.644 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:53.644 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:53.670 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:53.671 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:53.671 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:53.671 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:54.645 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:54.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:54.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:54.702 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:54.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:54.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:54.753 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:54.763 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:54.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:54.813 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:54.813 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:54.848 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:54.848 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:54.848 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:54.869 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:54.869 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:54.869 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:54.869 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:54.905 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:54.905 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:54.905 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:54.905 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:55.870 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:55.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:55.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:55.967 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:55.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:55.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:56.018 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:56.028 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:56.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:56.077 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:56.077 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:56.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:56.106 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:56.106 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:56.134 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:56.134 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:56.134 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:56.134 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:56.163 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:56.163 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:56.163 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:56.163 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:57.134 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:57.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:57.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:57.185 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:57.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:57.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:57.236 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:57.245 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:57.294 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:57.294 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:57.294 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:57.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:57.326 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:57.326 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:57.351 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:57.351 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:57.351 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:57.351 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:57.383 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:57.383 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:57.383 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:57.383 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:58.352 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:58.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:58.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:58.450 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:58.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:58.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:58.503 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:58.513 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:58.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:58.562 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:58.562 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:58.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:58.590 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:58.590 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:58.618 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:58.618 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:58.618 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:58.618 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:58.647 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:58.647 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:58.647 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:58.648 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:59.619 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:59.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:59.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:59.717 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:59.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:59.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:59.768 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:50:59.778 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:50:59.827 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:50:59.827 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:59.827 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:50:59.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:50:59.854 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:59.854 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:50:59.885 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:59.885 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:59.885 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:59.885 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:59.912 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:59.912 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:59.912 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:59.912 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:00.887 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:00.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:00.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:00.984 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:00.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:00.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:01.036 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:01.046 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:01.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:01.094 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:01.094 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:01.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:01.129 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:01.129 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:01.152 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:01.152 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:01.152 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:01.152 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:01.186 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:01.187 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:01.187 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:01.187 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:02.153 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:02.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:02.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:02.253 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:02.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:02.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:02.305 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:02.315 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:02.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:02.365 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:02.365 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:02.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:02.390 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:02.390 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:02.421 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:02.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:02.422 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:02.422 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:02.446 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:02.446 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:02.446 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:02.446 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:03.423 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:03.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:03.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:03.521 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:03.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:03.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:03.573 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:03.582 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:03.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:03.630 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:03.630 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:03.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:03.658 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:03.658 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:03.687 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:03.687 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:03.687 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:03.687 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:03.714 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:03.714 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:03.714 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:03.714 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:04.688 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:04.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:04.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:04.786 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:04.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:04.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:04.838 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:04.847 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:04.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:04.897 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:04.897 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:04.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:04.935 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:04.935 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:04.953 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:04.953 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:04.953 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:04.953 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:04.992 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:04.993 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:04.993 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:04.993 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:05.954 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:05.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:05.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:06.054 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:06.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:06.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:06.105 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:06.115 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:06.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:06.165 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:06.165 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:06.196 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:06.196 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:06.196 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:06.222 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:06.223 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:06.223 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:06.223 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:06.253 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:06.253 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:06.253 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:06.254 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:07.224 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:07.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:07.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:07.323 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:07.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:07.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:07.375 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:07.385 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:07.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:07.433 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:07.433 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:07.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:07.473 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:07.473 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:07.490 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:07.491 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:07.491 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:07.491 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:07.530 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:07.531 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:07.531 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:07.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:08.492 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:08.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:08.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:08.544 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:08.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:08.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:08.596 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:08.606 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:08.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:08.654 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:08.654 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:08.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:08.677 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:08.677 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:08.711 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:08.711 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:08.711 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:08.711 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:08.734 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:08.734 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:08.734 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:08.734 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:09.712 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:09.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:09.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:09.812 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:09.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:09.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:09.876 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:09.886 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:09.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:09.894 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:09.894 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:09.951 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:09.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:09.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:09.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:09.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:09.962 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:09.962 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:10.018 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:10.018 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:10.018 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:10.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:10.953 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:10.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:10.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:11.052 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:11.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:11.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:11.116 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:11.126 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:11.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:11.135 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:11.135 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:11.191 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:11.192 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:11.192 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:11.192 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:11.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:11.213 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:11.213 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:11.270 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:11.270 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:11.270 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:11.270 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:12.192 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:12.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:12.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:12.293 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:12.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:12.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:12.348 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:12.358 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:12.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:12.366 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:12.366 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:12.423 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:12.423 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:12.423 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:12.423 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:12.436 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:12.436 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:12.436 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:12.493 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:12.494 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:12.494 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:12.494 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:13.424 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:13.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:13.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:13.521 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:13.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:13.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:13.579 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:13.589 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:13.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:13.638 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:13.638 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:13.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:13.665 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:13.665 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:13.695 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:13.696 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:13.696 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:13.696 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:13.722 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:13.722 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:13.723 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:13.723 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:14.697 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:14.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:14.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:14.795 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:14.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:14.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:14.855 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:14.864 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:14.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:14.872 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:14.872 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:14.930 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:14.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:14.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:14.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:14.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:14.944 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:14.944 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:15.000 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:15.000 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:15.000 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:15.000 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:15.931 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:15.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:15.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:16.005 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:16.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:16.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:16.056 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:16.065 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:16.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:16.115 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:16.115 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:16.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:16.145 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:16.145 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:16.172 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:16.172 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:16.172 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:16.172 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:16.202 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:16.202 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:16.202 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:16.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:17.174 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:17.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:17.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:17.272 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:17.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:17.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:17.332 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:17.341 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:17.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:17.349 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:17.349 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:17.406 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:17.406 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:17.406 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:17.406 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:17.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:17.416 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:17.416 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:17.474 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:17.474 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:17.474 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:17.474 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:18.407 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:18.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:18.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:18.505 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:18.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:18.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:18.557 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:18.566 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:18.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:18.616 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:18.616 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:18.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:18.645 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:18.646 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:18.673 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:18.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:18.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:18.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:18.703 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:18.704 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:18.704 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:18.704 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:19.675 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:19.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:19.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:19.773 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:19.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:19.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:19.835 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:19.845 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:19.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:19.853 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:19.853 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:19.910 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:19.910 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:19.910 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:19.910 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:19.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:19.927 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:19.927 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:19.985 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:19.985 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:19.985 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:19.985 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:20.911 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:20.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:20.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:21.038 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:21.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:21.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:21.093 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:21.103 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:21.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:21.110 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:21.111 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:21.167 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:21.167 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:21.167 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:21.167 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:21.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:21.184 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:21.184 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:21.242 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:21.242 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:21.242 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:21.242 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:22.168 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:22.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:22.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:22.266 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:22.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:22.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:22.318 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:22.328 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:22.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:22.378 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:22.378 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:22.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:22.412 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:22.412 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:22.435 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:22.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:22.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:22.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:22.469 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:22.470 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:22.470 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:22.470 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:23.437 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:23.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:23.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:23.526 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:23.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:23.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:23.578 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:23.588 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:23.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:23.635 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:23.635 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:23.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:23.664 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:23.664 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:23.691 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:23.691 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:23.691 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:23.691 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:23.721 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:23.721 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:23.721 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:23.721 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:24.692 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:24.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:24.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:24.743 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:24.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:24.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:24.794 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:24.804 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:24.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:24.853 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:24.854 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:24.879 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:24.879 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:24.879 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:24.911 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:24.912 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:24.912 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:24.912 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:24.938 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:24.938 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:24.938 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:24.938 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:25.913 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:25.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:25.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:25.982 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:25.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:25.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:26.033 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:26.043 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:26.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:26.091 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:26.092 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:26.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:26.129 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:26.130 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:26.148 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:26.148 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:26.148 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:26.148 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:26.187 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:26.187 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:26.187 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:26.187 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:27.149 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:27.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:27.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:27.249 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:27.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:27.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:27.301 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:27.311 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:27.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:27.360 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:27.360 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:27.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:27.391 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:27.391 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:27.415 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:27.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:27.416 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:27.416 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:27.448 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:27.448 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:27.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:27.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:28.417 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:28.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:28.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:28.516 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:28.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:28.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:28.569 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:28.578 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:28.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:28.628 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:28.628 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:28.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:28.649 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:28.649 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:28.685 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:28.685 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:28.685 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:28.685 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:28.705 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:28.705 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:28.705 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:28.706 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:29.686 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:29.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:29.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:29.737 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:29.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:29.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:29.788 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:29.798 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:29.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:29.847 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:29.847 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:29.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:29.877 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:29.878 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:29.904 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:29.904 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:29.904 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:29.904 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:29.934 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:29.934 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:29.934 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:29.934 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:30.905 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:30.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:30.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:30.957 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:30.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:30.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:31.008 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:31.018 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:31.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:31.065 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:31.065 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:31.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:31.089 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:31.089 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:31.122 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:31.122 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:31.122 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:31.122 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:31.146 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:31.146 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:31.146 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:31.146 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:32.122 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:32.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:32.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:32.224 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:32.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:32.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:32.289 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:32.299 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:32.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:32.307 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:32.307 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:32.364 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:32.364 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:32.365 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:32.365 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:32.371 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:32.371 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:32.371 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:32.428 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:32.428 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:32.429 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:32.429 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:33.365 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:33.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:33.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:33.464 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:33.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:33.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:33.516 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:33.525 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:33.575 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:33.575 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:33.576 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:33.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:33.608 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:33.608 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:33.632 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:33.632 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:33.632 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:33.632 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:33.665 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:33.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:33.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:33.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:34.633 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:34.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:34.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:34.730 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:34.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:34.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:34.782 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:34.792 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:34.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:34.842 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:34.843 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:34.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:34.876 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:34.876 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:34.898 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:34.898 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:34.898 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:34.898 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:34.933 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:34.933 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:34.933 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:34.934 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:35.899 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:35.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:35.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:35.997 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:35.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:35.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:36.050 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:36.060 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:36.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:36.110 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:36.110 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:36.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:36.146 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:36.146 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:36.167 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:36.167 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:36.168 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:36.168 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:36.203 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:36.204 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:36.204 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:36.204 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:37.169 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:37.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:37.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:37.266 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:37.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:37.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:37.318 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:37.328 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:37.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:37.378 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:37.378 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:37.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:37.404 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:37.404 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:37.435 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:37.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:37.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:37.436 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:37.462 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:37.462 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:37.463 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:37.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:38.437 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:38.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:38.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:38.532 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:38.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:38.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:38.584 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:38.594 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:38.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:38.643 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:38.643 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:38.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:38.669 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:38.669 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:38.700 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:38.701 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:38.701 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:38.701 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:38.726 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:38.727 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:38.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:38.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:39.702 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:39.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:39.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:39.800 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:39.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:39.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:39.852 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:39.862 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:39.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:39.911 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:39.911 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:39.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:39.938 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:39.939 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:39.968 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:39.968 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:39.968 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:39.968 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:39.995 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:39.995 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:39.995 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:39.995 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:40.969 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:40.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:40.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:41.065 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:41.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:41.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:41.117 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:41.126 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:41.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:41.175 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:41.175 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:41.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:41.220 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:41.220 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:41.232 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:41.232 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:41.232 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:41.232 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:41.277 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:41.278 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:41.278 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:41.278 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:42.234 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:42.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:42.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:42.333 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:42.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:42.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:42.385 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:42.394 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:42.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:42.444 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:42.444 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:42.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:42.477 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:42.477 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:42.501 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:42.501 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:42.501 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:42.501 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:42.534 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:42.535 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:42.535 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:42.535 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:43.502 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:43.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:43.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:43.600 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:43.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:43.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:43.652 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:43.662 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:43.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:43.710 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:43.710 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:43.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:43.741 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:43.741 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:43.767 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:43.767 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:43.767 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:43.768 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:43.797 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:43.797 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:43.797 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:43.798 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:44.769 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:44.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:44.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:44.866 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:44.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:44.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:44.919 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:44.929 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:44.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:44.978 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:44.978 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:45.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:45.004 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:45.005 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:45.034 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:45.034 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:45.034 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:45.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:45.061 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:45.062 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:45.062 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:45.062 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:46.035 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:46.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:46.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:46.086 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:46.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:46.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:46.136 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:46.146 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:46.196 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:46.196 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:46.196 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:46.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:46.221 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:46.222 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:46.253 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:46.253 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:46.253 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:46.253 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:46.278 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:46.278 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:46.278 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:46.278 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:47.255 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:47.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:47.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:47.352 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:47.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:47.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:47.404 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:47.413 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:47.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:47.464 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:47.464 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:47.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:47.496 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:47.496 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:47.522 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:47.522 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:47.522 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:47.522 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:47.553 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:47.553 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:47.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:47.553 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:48.524 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:48.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:48.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:48.577 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:48.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:48.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:48.628 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:48.638 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:48.687 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:48.687 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:48.687 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:48.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:48.712 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:48.712 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:48.744 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:48.744 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:48.744 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:48.744 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:48.769 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:48.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:48.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:48.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:49.744 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:49.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:49.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:49.842 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:49.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:49.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:49.894 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:49.904 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:49.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:49.953 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:49.954 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:49.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:49.985 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:49.985 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:50.010 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:50.010 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:50.010 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:50.010 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:50.043 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:50.043 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:50.044 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:50.044 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:51.011 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:51.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:51.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:51.064 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:51.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:51.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:51.115 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:51.125 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:51.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:51.175 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:51.175 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:51.203 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:51.203 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:51.203 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:51.232 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:51.232 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:51.232 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:51.232 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:51.261 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:51.261 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:51.261 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:51.261 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:52.234 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:52.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:52.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:52.332 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:52.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:52.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:52.383 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:52.392 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:52.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:52.443 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:52.443 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:52.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:52.471 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:52.471 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:52.500 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:52.500 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:52.500 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:52.500 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:52.528 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:52.528 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:52.528 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:52.528 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:53.501 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:53.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:53.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:53.599 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:53.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:53.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:53.664 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:53.674 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:53.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:53.682 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:53.682 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:53.738 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:53.738 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:53.739 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:53.739 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:53.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:53.749 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:53.750 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:53.807 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:53.807 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:53.808 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:53.808 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:54.740 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:54.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:54.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:54.803 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:54.809 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:54.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:54.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:54.871 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:54.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:54.880 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:54.880 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:54.937 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:54.937 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:54.937 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:54.937 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:54.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:54.953 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:54.954 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:55.011 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:55.011 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:55.011 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:55.011 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:55.938 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:55.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:55.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:56.012 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:56.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:56.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:56.018 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:56.077 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:56.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:56.089 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:56.089 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:56.146 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:56.147 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:56.147 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:56.147 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:56.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:56.162 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:56.162 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:56.219 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:56.220 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:56.220 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:56.220 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:57.147 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:57.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:57.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:57.246 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:57.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:57.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:57.298 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:57.308 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:57.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:57.356 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:57.356 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:57.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:57.382 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:57.382 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:57.413 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:57.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:57.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:57.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:57.441 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:57.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:57.441 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:57.441 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:58.415 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:58.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:58.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:58.512 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:58.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:58.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:58.563 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:58.573 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:58.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:58.622 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:58.622 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:58.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:58.648 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:58.648 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:58.679 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:58.679 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:58.679 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:58.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:58.707 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:58.707 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:58.707 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:58.707 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:59.681 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:59.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:59.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:59.781 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:59.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:59.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:59.833 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:51:59.843 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:51:59.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:51:59.891 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:59.891 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:51:59.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:51:59.924 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:59.924 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:51:59.948 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:59.948 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:59.948 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:59.949 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:59.981 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:59.981 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:59.982 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:59.982 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:00.949 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:00.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:00.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:01.037 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:01.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:01.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:01.089 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:01.099 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:01.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:01.149 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:01.149 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:01.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:01.179 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:01.179 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:01.205 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:01.205 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:01.205 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:01.205 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:01.236 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:01.236 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:01.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:01.237 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:02.206 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:02.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:02.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:02.259 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:02.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:02.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:02.309 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:02.319 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:02.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:02.368 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:02.369 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:02.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:02.392 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:02.392 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:02.426 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:02.426 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:02.426 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:02.426 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:02.448 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:02.449 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:02.449 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:02.449 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:03.427 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:03.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:03.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:03.527 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:03.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:03.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:03.579 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:03.589 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:03.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:03.637 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:03.637 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:03.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:03.669 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:03.669 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:03.694 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:03.694 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:03.694 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:03.694 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:03.725 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:03.725 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:03.725 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:03.725 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:04.695 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:04.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:04.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:04.793 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:04.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:04.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:04.845 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:04.855 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:04.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:04.905 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:04.905 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:04.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:04.935 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:04.936 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:04.962 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:04.962 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:04.962 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:04.962 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:04.992 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:04.992 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:04.992 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:04.992 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:05.963 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:05.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:05.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:06.062 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:06.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:06.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:06.114 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:06.123 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:06.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:06.172 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:06.172 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:06.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:06.199 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:06.199 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:06.228 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:06.228 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:06.228 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:06.228 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:06.255 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:06.255 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:06.256 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:06.256 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:07.230 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:07.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:07.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:07.318 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:07.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:07.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:07.369 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:07.379 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:07.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:07.428 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:07.428 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:07.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:07.452 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:07.452 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:07.485 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:07.485 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:07.485 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:07.485 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:07.508 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:07.509 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:07.509 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:07.509 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:08.486 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:08.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:08.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:08.584 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:08.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:08.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:08.636 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:08.645 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:08.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:08.695 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:08.695 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:08.723 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:08.723 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:08.723 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:08.751 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:08.752 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:08.752 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:08.752 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:08.781 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:08.781 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:08.781 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:08.781 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:09.752 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:09.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:09.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:09.850 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:09.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:09.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:09.902 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:09.912 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:09.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:09.962 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:09.962 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:10.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:10.003 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:10.003 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:10.020 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:10.020 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:10.021 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:10.021 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:10.060 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:10.060 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:10.060 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:10.061 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:11.022 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:11.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:11.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:11.073 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:11.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:11.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:11.124 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:11.134 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:11.183 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:11.183 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:11.183 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:11.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:11.213 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:11.214 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:11.240 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:11.240 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:11.240 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:11.240 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:11.271 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:11.271 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:11.271 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:11.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:12.242 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:12.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:12.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:12.341 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:12.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:12.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:12.394 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:12.403 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:12.453 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:12.454 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:12.454 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:12.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:12.478 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:12.478 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:12.510 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:12.511 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:12.511 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:12.511 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:12.535 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:12.535 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:12.536 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:12.536 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:13.512 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:13.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:13.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:13.609 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:13.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:13.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:13.673 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:13.683 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:13.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:13.691 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:13.691 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:13.749 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:13.749 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:13.749 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:13.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:13.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:13.764 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:13.764 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:13.821 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:13.822 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:13.822 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:13.822 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:14.750 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:14.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:14.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:14.848 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:14.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:14.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:14.902 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:14.912 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:14.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:14.961 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:14.961 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:14.991 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:14.991 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:14.991 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:15.018 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:15.018 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:15.018 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:15.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:15.047 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:15.048 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:15.048 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:15.048 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:16.020 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:16.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:16.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:16.119 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:16.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:16.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:16.172 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:16.181 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:16.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:16.230 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:16.231 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:16.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:16.256 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:16.256 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:16.287 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:16.287 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:16.287 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:16.287 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:16.312 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:16.312 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:16.312 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:16.312 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:17.288 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:17.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:17.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:17.388 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:17.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:17.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:17.440 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:17.450 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:17.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:17.497 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:17.498 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:17.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:17.531 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:17.531 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:17.554 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:17.554 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:17.554 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:17.554 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:17.589 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:17.589 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:17.589 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:17.589 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:18.555 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:18.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:18.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:18.647 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:18.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:18.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:18.698 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:18.708 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:18.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:18.758 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:18.758 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:18.781 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:18.781 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:18.781 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:18.815 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:18.815 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:18.815 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:18.815 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:18.837 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:18.837 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:18.837 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:18.837 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:19.816 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:19.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:19.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:19.917 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:19.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:19.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:19.971 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:19.981 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:20.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:20.031 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:20.031 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:20.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:20.054 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:20.054 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:20.090 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:20.091 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:20.091 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:20.091 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:20.112 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:20.113 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:20.113 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:20.113 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:21.092 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:21.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:21.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:21.192 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:21.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:21.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:21.244 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:21.253 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:21.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:21.302 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:21.303 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:21.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:21.333 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:21.333 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:21.360 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:21.360 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:21.360 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:21.360 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:21.390 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:21.390 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:21.390 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:21.390 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:22.361 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:22.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:22.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:22.462 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:22.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:22.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:22.514 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:22.524 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:22.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:22.572 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:22.572 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:22.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:22.606 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:22.606 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:22.629 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:22.629 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:22.629 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:22.629 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:22.663 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:22.663 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:22.663 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:22.663 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:23.631 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:23.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:23.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:23.725 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:23.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:23.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:23.787 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:23.797 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:23.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:23.805 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:23.805 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:23.862 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:23.863 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:23.863 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:23.863 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:23.871 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:23.871 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:23.871 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:23.929 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:23.929 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:23.929 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:23.929 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:24.864 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:24.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:24.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:24.962 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:24.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:24.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:25.015 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:25.025 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:25.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:25.073 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:25.073 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:25.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:25.101 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:25.101 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:25.129 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:25.129 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:25.130 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:25.130 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:25.158 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:25.158 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:25.158 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:25.158 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:26.130 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:26.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:26.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:26.228 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:26.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:26.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:26.280 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:26.289 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:26.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:26.340 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:26.340 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:26.371 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:26.371 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:26.371 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:26.398 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:26.398 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:26.398 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:26.398 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:26.428 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:26.428 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:26.428 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:26.429 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:27.400 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:27.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:27.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:27.499 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:27.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:27.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:27.555 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:27.565 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:27.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:27.613 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:27.613 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:27.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:27.638 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:27.638 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:27.671 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:27.671 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:27.671 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:27.671 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:27.696 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:27.697 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:27.697 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:27.697 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:28.672 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:28.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:28.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:28.774 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:28.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:28.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:28.825 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:28.835 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:28.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:28.884 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:28.884 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:28.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:28.908 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:28.908 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:28.941 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:28.941 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:28.941 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:28.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:28.966 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:28.966 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:28.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:28.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:29.942 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:29.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:29.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:30.042 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:30.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:30.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:30.094 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:30.104 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:30.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:30.153 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:30.153 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:30.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:30.185 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:30.185 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:30.210 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:30.210 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:30.210 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:30.211 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:30.242 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:30.242 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:30.242 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:30.242 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:31.212 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:31.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:31.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:31.310 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:31.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:31.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:31.362 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:31.372 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:31.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:31.422 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:31.422 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:31.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:31.446 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:31.447 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:31.480 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:31.480 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:31.480 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:31.481 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:31.504 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:31.504 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:31.505 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:31.505 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:32.482 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:32.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:32.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:32.580 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:32.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:32.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:32.632 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:32.642 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:32.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:32.692 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:32.692 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:32.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:32.719 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:32.719 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:32.749 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:32.749 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:32.749 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:32.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:32.776 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:32.777 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:32.777 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:32.777 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:33.750 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:33.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:33.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:33.850 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:33.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:33.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:33.903 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:33.912 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:33.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:33.961 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:33.962 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:34.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:34.001 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:34.001 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:34.018 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:34.018 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:34.018 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:34.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:34.058 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:34.058 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:34.058 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:34.058 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:35.020 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:35.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:35.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:35.119 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:35.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:35.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:35.171 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:35.181 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:35.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:35.230 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:35.230 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:35.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:35.256 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:35.256 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:35.286 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:35.287 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:35.287 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:35.287 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:35.312 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:35.312 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:35.312 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:35.312 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:36.287 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:36.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:36.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:36.386 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:36.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:36.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:36.438 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:36.447 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:36.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:36.496 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:36.497 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:36.528 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:36.528 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:36.529 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:36.553 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:36.553 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:36.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:36.553 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:36.585 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:36.585 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:36.585 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:36.585 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:37.554 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:37.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:37.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:37.651 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:37.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:37.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:37.703 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:37.713 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:37.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:37.762 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:37.763 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:37.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:37.795 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:37.796 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:37.819 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:37.819 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:37.819 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:37.819 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:37.852 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:37.852 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:37.852 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:37.852 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:38.820 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:38.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:38.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:38.893 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:38.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:38.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:38.951 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:38.961 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:38.969 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:38.969 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:38.969 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:39.026 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:39.026 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:39.026 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:39.026 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:39.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:39.034 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:39.034 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:39.092 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:39.092 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:39.093 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:39.093 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:40.027 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:40.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:40.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:40.125 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:40.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:40.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:40.177 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:40.187 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:40.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:40.236 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:40.236 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:40.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:40.274 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:40.274 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:40.293 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:40.294 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:40.294 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:40.294 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:40.332 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:40.333 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:40.333 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:40.333 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:41.296 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:41.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:41.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:41.393 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:41.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:41.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:41.445 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:41.455 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:41.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:41.504 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:41.505 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:41.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:41.530 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:41.531 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:41.561 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:41.561 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:41.561 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:41.561 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:41.587 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:41.588 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:41.588 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:41.588 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:42.562 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:42.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:42.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:42.661 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:42.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:42.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:42.713 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:42.723 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:42.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:42.774 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:42.774 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:42.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:42.803 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:42.803 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:42.831 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:42.831 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:42.831 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:42.831 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:42.859 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:42.859 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:42.859 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:42.859 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:43.832 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:43.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:43.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:43.928 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:43.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:43.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:43.981 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:43.991 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:44.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:44.041 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:44.041 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:44.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:44.071 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:44.072 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:44.097 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:44.097 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:44.097 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:44.097 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:44.129 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:44.129 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:44.129 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:44.130 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:45.098 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:45.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:45.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:45.195 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:45.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:45.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:45.256 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:45.265 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:45.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:45.273 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:45.273 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:45.330 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:45.330 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:45.330 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:45.330 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:45.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:45.354 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:45.354 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:45.411 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:45.412 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:45.412 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:45.412 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:46.331 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:46.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:46.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:46.430 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:46.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:46.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:46.494 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:46.504 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:46.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:46.512 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:46.512 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:46.569 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:46.570 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:46.570 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:46.570 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:46.579 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:46.579 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:46.579 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:46.636 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:46.636 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:46.636 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:46.637 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:47.571 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:47.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:47.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:47.671 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:47.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:47.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:47.724 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:47.734 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:47.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:47.783 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:47.783 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:47.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:47.815 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:47.815 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:47.840 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:47.841 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:47.841 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:47.841 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:47.873 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:47.873 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:47.873 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:47.873 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:48.842 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:48.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:48.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:48.941 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:48.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:48.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:48.993 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:49.003 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:49.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:49.051 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:49.051 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:49.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:49.090 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:49.090 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:49.108 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:49.108 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:49.108 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:49.108 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:49.146 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:49.147 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:49.147 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:49.147 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:50.109 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:50.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:50.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:50.209 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:50.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:50.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:50.261 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:50.272 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:50.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:50.321 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:50.321 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:50.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:50.357 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:50.357 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:50.379 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:50.379 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:50.379 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:50.379 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:50.416 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:50.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:50.417 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:50.417 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:51.380 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:51.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:51.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:51.475 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:51.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:51.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:51.542 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:51.551 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:51.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:51.559 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:51.559 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:51.616 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:51.616 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:51.616 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:51.616 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:51.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:51.641 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:51.641 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:51.698 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:51.699 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:51.699 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:51.699 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:52.618 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:52.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:52.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:52.717 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:52.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:52.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:52.781 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:52.791 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:52.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:52.800 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:52.800 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:52.857 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:52.857 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:52.858 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:52.858 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:52.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:52.870 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:52.870 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:52.927 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:52.928 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:52.928 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:52.928 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:53.859 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:53.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:53.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:53.959 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:53.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:53.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:54.011 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:54.021 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:54.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:54.072 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:54.072 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:54.111 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:54.111 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:54.111 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:54.130 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:54.130 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:54.130 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:54.130 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:54.169 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:54.169 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:54.169 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:54.170 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:55.131 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:55.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:55.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:55.230 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:55.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:55.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:55.290 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:55.300 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:55.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:55.308 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:55.308 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:55.365 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:55.365 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:55.365 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:55.365 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:55.375 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:55.375 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:55.375 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:55.433 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:55.433 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:55.433 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:55.433 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:56.366 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:56.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:56.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:56.432 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:56.435 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:56.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:56.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:56.501 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:56.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:56.517 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:56.518 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:56.575 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:56.575 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:56.575 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:56.575 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:56.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:56.580 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:56.580 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:56.637 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:56.638 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:56.638 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:56.638 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:57.577 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:57.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:57.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:57.676 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:57.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:57.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:57.728 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:57.738 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:57.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:57.788 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:57.788 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:57.812 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:57.812 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:57.812 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:57.844 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:57.845 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:57.845 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:57.845 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:57.869 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:57.869 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:57.869 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:57.869 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:58.845 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:58.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:58.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:58.944 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:58.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:58.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:58.996 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:52:59.005 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:52:59.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:52:59.054 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:59.055 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:52:59.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:52:59.079 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:59.079 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:52:59.111 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:59.111 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:59.111 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:59.111 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:59.137 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:59.137 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:59.137 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:59.138 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:00.113 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:00.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:00.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:00.211 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:00.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:00.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:00.262 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:00.272 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:00.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:00.323 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:00.323 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:00.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:00.344 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:00.344 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:00.380 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:00.380 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:00.380 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:00.380 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:00.402 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:00.402 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:00.402 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:00.402 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:01.381 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:01.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:01.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:01.494 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:01.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:01.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:01.552 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:01.561 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:01.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:01.571 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:01.571 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:01.628 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:01.628 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:01.628 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:01.628 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:01.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:01.642 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:01.642 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:01.701 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:01.701 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:01.701 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:01.701 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:02.629 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:02.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:02.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:02.727 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:02.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:02.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:02.779 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:02.789 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:02.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:02.838 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:02.838 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:02.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:02.870 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:02.870 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:02.896 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:02.896 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:02.896 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:02.896 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:02.926 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:02.927 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:02.927 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:02.927 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:03.897 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:03.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:03.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:03.995 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:03.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:03.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:04.047 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:04.057 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:04.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:04.107 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:04.107 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:04.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:04.139 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:04.139 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:04.164 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:04.164 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:04.164 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:04.164 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:04.196 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:04.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:04.196 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:04.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:05.166 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:05.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:05.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:05.265 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:05.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:05.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:05.317 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:05.326 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:05.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:05.376 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:05.376 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:05.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:05.409 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:05.409 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:05.433 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:05.433 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:05.433 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:05.433 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:05.466 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:05.466 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:05.466 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:05.467 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:06.434 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:06.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:06.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:06.531 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:06.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:06.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:06.583 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:06.593 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:06.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:06.642 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:06.642 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:06.663 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:06.663 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:06.664 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:06.699 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:06.699 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:06.699 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:06.699 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:06.721 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:06.721 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:06.721 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:06.721 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:07.700 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:07.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:07.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:07.799 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:07.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:07.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:07.851 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:07.861 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:07.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:07.911 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:07.911 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:07.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:07.944 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:07.944 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:07.968 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:07.968 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:07.968 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:07.968 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:08.001 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:08.001 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:08.001 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:08.001 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:08.969 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:08.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:08.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:09.067 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:09.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:09.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:09.120 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:09.129 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:09.179 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:09.179 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:09.179 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:09.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:09.206 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:09.206 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:09.235 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:09.236 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:09.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:09.236 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:09.263 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:09.263 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:09.263 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:09.264 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:10.237 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:10.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:10.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:10.336 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:10.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:10.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:10.388 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:10.398 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:10.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:10.448 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:10.448 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:10.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:10.475 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:10.475 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:10.505 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:10.505 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:10.505 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:10.505 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:10.532 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:10.532 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:10.532 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:10.532 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:11.506 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:11.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:11.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:11.604 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:11.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:11.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:11.657 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:11.667 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:11.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:11.716 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:11.716 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:11.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:11.744 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:11.744 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:11.772 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:11.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:11.773 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:11.773 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:11.801 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:11.801 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:11.801 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:11.801 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:12.774 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:12.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:12.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:12.873 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:12.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:12.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:12.925 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:12.935 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:12.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:12.986 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:12.986 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:13.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:13.018 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:13.018 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:13.042 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:13.043 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:13.043 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:13.043 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:13.074 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:13.074 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:13.074 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:13.074 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:14.044 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:14.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:14.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:14.143 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:14.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:14.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:14.196 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:14.205 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:14.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:14.255 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:14.255 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:14.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:14.291 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:14.291 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:14.311 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:14.312 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:14.312 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:14.312 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:14.348 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:14.348 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:14.348 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:14.348 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:15.313 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:15.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:15.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:15.411 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:15.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:15.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:15.463 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:15.473 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:15.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:15.523 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:15.523 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:15.555 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:15.555 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:15.555 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:15.582 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:15.582 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:15.582 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:15.582 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:15.612 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:15.612 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:15.612 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:15.612 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:16.583 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:16.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:16.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:16.684 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:16.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:16.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:16.735 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:16.745 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:16.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:16.794 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:16.794 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:16.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:16.826 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:16.826 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:16.851 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:16.851 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:16.852 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:16.852 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:16.883 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:16.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:16.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:16.883 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:17.853 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:17.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:17.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:17.951 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:17.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:17.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:18.003 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:18.012 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:18.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:18.062 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:18.062 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:18.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:18.105 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:18.105 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:18.121 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:18.121 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:18.121 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:18.121 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:18.162 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:18.163 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:18.163 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:18.163 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:19.123 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:19.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:19.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:19.221 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:19.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:19.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:19.273 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:19.283 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:19.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:19.331 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:19.332 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:19.372 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:19.372 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:19.373 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:19.388 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:19.388 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:19.388 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:19.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:19.430 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:19.430 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:19.430 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:19.431 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:20.390 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:20.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:20.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:20.488 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:20.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:20.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:20.549 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:20.559 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:20.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:20.566 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:20.567 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:20.624 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:20.624 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:20.624 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:20.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:20.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:20.641 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:20.641 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:20.698 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:20.699 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:20.699 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:20.699 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:21.625 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:21.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:21.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:21.690 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:21.700 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:21.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:21.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:21.768 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:21.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:21.776 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:21.776 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:21.832 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:21.832 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:21.832 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:21.832 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:21.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:21.853 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:21.854 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:21.912 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:21.913 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:21.913 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:21.913 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:22.833 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:22.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:22.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:22.931 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:22.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:22.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:22.984 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:22.993 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:23.044 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:23.044 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:23.044 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:23.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:23.083 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:23.083 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:23.101 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:23.102 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:23.102 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:23.102 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:23.140 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:23.140 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:23.140 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:23.140 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:24.103 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:24.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:24.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:24.201 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:24.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:24.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:24.254 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:24.264 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:24.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:24.312 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:24.312 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:24.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:24.341 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:24.341 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:24.369 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:24.369 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:24.369 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:24.369 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:24.398 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:24.398 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:24.398 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:24.398 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:25.370 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:25.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:25.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:25.468 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:25.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:25.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:25.519 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:25.528 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:25.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:25.577 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:25.577 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:25.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:25.604 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:25.604 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:25.635 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:25.636 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:25.636 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:25.636 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:25.661 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:25.661 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:25.661 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:25.662 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:26.637 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:26.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:26.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:26.736 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:26.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:26.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:26.787 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:26.797 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:26.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:26.847 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:26.847 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:26.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:26.885 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:26.885 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:26.905 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:26.905 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:26.905 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:26.905 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:26.943 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:26.943 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:26.944 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:26.944 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:27.907 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:27.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:27.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:28.005 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:28.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:28.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:28.071 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:28.081 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:28.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:28.089 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:28.089 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:28.145 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:28.146 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:28.146 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:28.146 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:28.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:28.156 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:28.156 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:28.212 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:28.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:28.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:28.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:29.146 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:29.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:29.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:29.245 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:29.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:29.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:29.298 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:29.308 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:29.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:29.356 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:29.356 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:29.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:29.390 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:29.390 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:29.412 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:29.412 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:29.412 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:29.412 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:29.447 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:29.448 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:29.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:29.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:30.413 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:30.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:30.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:30.511 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:30.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:30.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:30.563 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:30.573 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:30.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:30.623 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:30.623 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:30.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:30.652 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:30.652 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:30.679 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:30.679 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:30.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:30.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:30.708 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:30.708 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:30.708 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:30.708 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:31.680 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:31.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:31.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:31.779 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:31.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:31.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:31.831 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:31.840 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:31.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:31.890 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:31.890 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:31.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:31.928 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:31.928 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:31.947 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:31.947 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.947 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:31.947 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:31.988 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:31.988 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.988 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:31.988 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:32.948 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:32.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:32.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:33.047 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:33.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:33.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:33.099 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:33.109 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:33.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:33.159 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:33.159 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:33.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:33.190 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:33.191 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:33.217 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:33.217 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:33.217 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:33.217 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:33.249 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:33.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:33.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:33.250 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:34.218 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:34.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:34.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:34.317 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:34.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:34.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:34.374 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:34.384 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:34.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:34.392 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:34.392 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:34.449 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:34.449 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:34.449 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:34.449 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:34.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:34.474 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:34.474 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:34.532 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:34.532 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:34.532 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:34.533 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:35.450 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:35.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:35.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:35.549 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:35.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:35.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:35.602 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:35.612 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:35.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:35.660 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:35.661 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:35.696 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:35.696 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:35.697 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:35.718 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:35.718 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:35.718 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:35.718 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:35.753 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:35.754 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:35.754 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:35.754 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:36.720 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:36.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:36.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:36.818 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:36.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:36.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:36.871 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:36.881 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:36.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:36.930 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:36.930 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:36.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:36.953 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:36.953 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:36.986 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:36.986 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:36.986 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:36.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:37.010 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:37.010 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:37.010 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:37.010 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:37.987 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:37.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:37.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:38.087 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:38.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:38.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:38.144 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:38.152 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:38.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:38.161 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:38.161 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:38.219 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:38.219 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:38.220 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:38.220 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:38.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:38.230 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:38.230 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:38.286 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:38.287 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:38.287 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:38.287 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:39.221 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:39.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:39.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:39.320 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:39.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:39.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:39.372 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:39.382 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:39.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:39.430 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:39.431 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:39.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:39.462 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:39.462 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:39.487 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:39.487 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:39.487 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:39.487 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:39.519 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:39.519 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:39.519 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:39.519 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:40.489 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:40.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:40.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:40.588 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:40.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:40.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:40.639 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:40.649 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:40.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:40.698 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:40.698 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:40.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:40.730 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:40.730 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:40.755 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:40.755 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:40.755 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:40.755 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:40.786 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:40.787 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:40.787 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:40.787 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:41.756 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:41.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:41.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:41.854 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:41.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:41.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:41.907 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:41.916 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:41.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:41.966 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:41.966 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:41.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:41.994 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:41.994 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:42.022 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:42.022 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:42.022 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:42.022 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:42.050 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:42.051 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:42.051 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:42.051 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:43.023 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:43.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:43.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:43.122 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:43.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:43.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:43.173 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:43.183 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:43.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:43.234 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:43.234 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:43.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:43.259 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:43.259 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:43.290 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:43.291 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:43.291 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:43.291 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:43.315 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:43.315 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:43.315 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:43.315 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:44.292 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:44.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:44.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:44.390 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:44.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:44.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:44.442 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:44.452 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:44.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:44.501 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:44.501 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:44.540 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:44.541 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:44.541 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:44.558 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:44.558 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:44.558 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:44.558 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:44.597 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:44.597 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:44.597 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:44.597 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:45.559 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:45.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:45.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:45.657 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:45.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:45.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:45.710 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:45.719 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:45.769 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:45.769 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:45.769 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:45.799 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:45.799 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:45.799 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:45.826 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:45.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:45.827 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:45.827 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:45.857 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:45.857 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:45.857 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:45.857 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:46.828 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:46.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:46.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:46.926 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:46.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:46.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:46.978 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:46.987 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:47.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:47.037 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:47.037 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:47.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:47.067 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:47.067 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:47.094 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:47.095 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:47.095 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:47.095 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:47.124 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:47.125 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:47.125 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:47.125 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:48.096 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:48.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:48.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:48.188 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:48.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:48.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:48.240 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:48.250 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:48.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:48.299 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:48.299 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:48.332 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:48.332 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:48.332 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:48.356 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:48.357 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:48.357 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:48.357 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:48.389 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:48.389 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:48.390 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:48.390 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:49.358 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:49.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:49.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:49.456 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:49.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:49.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:49.508 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:49.518 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:49.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:49.566 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:49.566 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:49.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:49.600 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:49.600 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:49.624 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:49.625 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:49.625 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:49.625 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:49.656 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:49.656 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:49.656 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:49.656 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:50.625 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:50.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:50.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:50.727 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:50.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:50.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:50.794 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:50.803 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:50.811 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:50.811 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:50.811 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:50.868 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:50.868 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:50.868 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:50.868 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:50.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:50.877 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:50.877 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:50.935 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:50.935 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:50.936 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:50.936 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:51.870 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:51.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:51.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:51.968 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:51.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:51.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:52.033 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:52.045 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:52.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:52.053 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:52.053 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:52.110 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:52.110 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:52.110 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:52.110 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:52.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:52.128 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:52.128 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:52.184 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:52.185 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:52.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:52.185 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:53.111 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:53.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:53.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:53.209 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:53.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:53.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:53.273 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:53.283 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:53.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:53.291 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:53.291 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:53.349 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:53.349 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:53.349 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:53.349 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:53.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:53.361 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:53.361 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:53.418 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:53.418 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:53.419 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:53.419 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:54.350 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:54.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:54.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:54.449 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:54.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:54.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:54.502 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:54.511 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:54.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:54.561 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:54.561 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:54.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:54.596 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:54.596 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:54.618 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:54.618 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:54.618 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:54.618 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:54.653 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:54.653 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:54.653 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:54.653 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:55.619 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:55.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:55.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:55.704 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:55.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:55.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:55.756 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:55.766 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:55.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:55.816 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:55.816 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:55.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:55.851 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:55.851 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:55.873 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:55.873 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:55.873 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:55.873 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:55.909 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:55.909 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:55.909 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:55.910 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:56.874 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:56.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:56.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:56.973 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:56.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:56.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:57.029 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:57.039 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:57.047 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:57.047 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:57.047 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:57.103 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:57.104 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:57.104 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:57.104 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:57.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:57.115 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:57.116 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:57.172 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:57.172 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:57.172 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:57.173 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:58.105 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:58.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:58.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:58.203 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:58.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:58.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:58.261 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:58.270 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:58.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:58.278 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:58.279 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:58.335 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:58.336 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:58.336 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:58.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:58.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:58.355 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:58.355 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:58.412 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:58.412 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:58.412 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:58.412 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:59.337 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:59.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:59.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:59.414 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:59.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:59.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:59.423 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:53:59.474 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:53:59.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:53:59.493 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:59.493 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:53:59.550 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:59.550 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:59.550 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:59.550 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:59.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:53:59.556 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:59.556 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:53:59.613 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:59.613 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:59.613 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:59.613 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:00.550 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:00.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:54:00.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:00.651 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:00.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:54:00.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:00.704 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:54:00.713 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:54:00.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:54:00.762 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:00.762 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:54:00.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:54:00.797 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:00.797 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:54:00.818 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:00.819 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:00.819 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:00.819 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:00.855 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:00.855 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:00.855 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:00.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:01.819 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:01.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:54:01.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:01.918 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:01.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:54:01.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:01.981 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:54:01.991 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:54:01.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:54:01.999 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:01.999 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:54:02.056 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:02.056 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:02.056 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:02.056 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:02.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:54:02.078 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:02.078 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:54:02.135 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:02.136 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:02.136 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:02.136 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:03.057 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:03.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:54:03.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:03.123 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:54:03.137 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:03.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:54:03.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:03.198 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:54:03.207 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:54:03.207 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:03.207 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:54:03.264 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:03.264 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:03.264 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:03.264 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:03.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:54:03.275 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:03.275 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:54:03.332 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:03.333 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:03.333 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:03.333 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:04.265 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:04.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:54:04.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:04.330 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:54:04.334 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:04.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:54:04.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:04.395 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:54:04.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:54:04.406 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:04.406 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:54:04.464 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:04.464 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:04.464 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:04.464 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:04.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:54:04.470 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:04.470 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:54:04.526 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:04.527 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:04.527 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:04.527 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:05.465 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:05.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:54:05.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:05.564 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:05.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:54:05.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:05.616 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:54:05.626 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:54:05.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:54:05.675 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:05.675 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:54:05.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:54:05.705 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:05.705 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:54:05.733 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:05.733 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:05.733 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:05.733 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:05.762 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:05.762 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:05.762 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:05.762 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:06.735 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:06.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:54:06.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:06.787 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:06.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:54:06.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:06.838 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:54:06.847 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:54:06.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:54:06.897 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:06.897 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:54:06.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:54:06.919 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:06.919 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:54:06.954 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:06.954 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:06.954 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:06.954 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:06.976 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:06.976 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:06.976 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:06.976 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:07.955 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:07.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:54:07.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:08.053 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:08.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:54:08.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:08.104 DEBUG:teuthology.orchestra.run.trial193:> true 2026-02-12T22:54:08.114 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:54:08.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial193.front.sepia.ceph.com' 2026-02-12T22:54:08.162 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:08.162 DEBUG:teuthology.orchestra.run.trial193:> uname -r 2026-02-12T22:54:08.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:54:08.201 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:08.201 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:54:08.219 INFO:teuthology.orchestra.run.trial193.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:08.219 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:08.220 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:08.220 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:08.221 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:08.223 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:54:08.235 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:54:08.267 INFO:teuthology.run:Summary data: description: fs/snaps/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-1c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/workunit/snaps} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:54:08.267 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:54:08.352 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:08.352 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:08.352 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:08.352 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:08.402 INFO:teuthology.run:FAIL