2026-02-12T22:48:20.224 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:48:20.241 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:48:20.327 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47307 branch: wip-pdonnell-testing-20260210.171210 description: fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/workunit/dir-max-entries} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47307' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds use global snaprealm seq for subvol: false mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5EOLzXIiUhiMwG3rKpc9TrsAJ6cYdVX3v9Jh/n5SlmQb8mZc4P84cc+TF9/j17qqFgg20Y6j8zq9SYtiinEX8= trial163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD26I7HCOSBkW0RjUoweo4dvY4LsmDNUWXGDTIAbDh6xYkUgjdFxlWhkWGejF39KBHtg7byHkLauKhGr7QxGqC8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - ceph-fuse: null - workunit: clients: client.0: - fs/maxentries teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:48:20.327 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:48:20.328 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:48:20.328 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:48:20.329 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:48:20.329 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:48:20.329 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:48:20.329 INFO:teuthology.packaging:ref: None 2026-02-12T22:48:20.329 INFO:teuthology.packaging:tag: None 2026-02-12T22:48:20.329 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:48:20.329 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:48:20.329 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:48:20.449 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:48:20.450 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:48:20.460 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:48:20.460 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:48:20.473 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:48:20.489 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:48:20.507 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:48:20.584 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial089.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47307', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:44:56.926501', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5EOLzXIiUhiMwG3rKpc9TrsAJ6cYdVX3v9Jh/n5SlmQb8mZc4P84cc+TF9/j17qqFgg20Y6j8zq9SYtiinEX8='} 2026-02-12T22:48:20.637 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial163.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47307', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:44:56.925814', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD26I7HCOSBkW0RjUoweo4dvY4LsmDNUWXGDTIAbDh6xYkUgjdFxlWhkWGejF39KBHtg7byHkLauKhGr7QxGqC8='} 2026-02-12T22:48:20.638 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:48:20.648 INFO:teuthology.task.internal:roles: ubuntu@trial089.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2026-02-12T22:48:20.648 INFO:teuthology.task.internal:roles: ubuntu@trial163.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2026-02-12T22:48:20.648 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:48:20.779 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7432b0ee7c40>, signals=[15]) 2026-02-12T22:48:20.779 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:48:20.790 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:48:20.790 DEBUG:teuthology.task.internal:connecting to ubuntu@trial089.front.sepia.ceph.com 2026-02-12T22:48:20.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:20.851 DEBUG:teuthology.task.internal:connecting to ubuntu@trial163.front.sepia.ceph.com 2026-02-12T22:48:20.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:20.913 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:48:20.924 DEBUG:teuthology.orchestra.run.trial089:> uname -m 2026-02-12T22:48:20.941 INFO:teuthology.orchestra.run.trial089.stdout:x86_64 2026-02-12T22:48:20.941 DEBUG:teuthology.orchestra.run.trial089:> cat /etc/os-release 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:NAME="Rocky Linux" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:ID="rocky" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:VERSION_ID="10.1" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:ANSI_COLOR="0;32" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:VENDOR_NAME="RESF" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:48:20.998 INFO:teuthology.orchestra.run.trial089.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:48:20.999 INFO:teuthology.orchestra.run.trial089.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:48:20.999 INFO:teuthology.orchestra.run.trial089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:48:20.999 INFO:teuthology.lock.ops:Updating trial089.front.sepia.ceph.com on lock server 2026-02-12T22:48:21.068 DEBUG:teuthology.orchestra.run.trial163:> uname -m 2026-02-12T22:48:21.085 INFO:teuthology.orchestra.run.trial163.stdout:x86_64 2026-02-12T22:48:21.085 DEBUG:teuthology.orchestra.run.trial163:> cat /etc/os-release 2026-02-12T22:48:21.141 INFO:teuthology.orchestra.run.trial163.stdout:NAME="Rocky Linux" 2026-02-12T22:48:21.142 INFO:teuthology.orchestra.run.trial163.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:48:21.142 INFO:teuthology.orchestra.run.trial163.stdout:ID="rocky" 2026-02-12T22:48:21.142 INFO:teuthology.orchestra.run.trial163.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:48:21.142 INFO:teuthology.orchestra.run.trial163.stdout:VERSION_ID="10.1" 2026-02-12T22:48:21.142 INFO:teuthology.orchestra.run.trial163.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:48:21.142 INFO:teuthology.orchestra.run.trial163.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:48:21.142 INFO:teuthology.orchestra.run.trial163.stdout:ANSI_COLOR="0;32" 2026-02-12T22:48:21.142 INFO:teuthology.orchestra.run.trial163.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:48:21.142 INFO:teuthology.orchestra.run.trial163.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:48:21.143 INFO:teuthology.orchestra.run.trial163.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:48:21.143 INFO:teuthology.orchestra.run.trial163.stdout:VENDOR_NAME="RESF" 2026-02-12T22:48:21.143 INFO:teuthology.orchestra.run.trial163.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:48:21.143 INFO:teuthology.orchestra.run.trial163.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:48:21.143 INFO:teuthology.orchestra.run.trial163.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:48:21.143 INFO:teuthology.orchestra.run.trial163.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:48:21.143 INFO:teuthology.orchestra.run.trial163.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:48:21.143 INFO:teuthology.orchestra.run.trial163.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:48:21.143 INFO:teuthology.orchestra.run.trial163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:48:21.143 INFO:teuthology.lock.ops:Updating trial163.front.sepia.ceph.com on lock server 2026-02-12T22:48:21.225 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:48:21.240 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:48:21.251 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:48:21.251 DEBUG:teuthology.orchestra.run.trial089:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:48:21.252 DEBUG:teuthology.orchestra.run.trial163:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:48:21.269 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:48:21.280 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:48:21.280 DEBUG:teuthology.orchestra.run.trial089:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:48:21.309 DEBUG:teuthology.orchestra.run.trial163:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:48:21.324 INFO:teuthology.orchestra.run.trial089.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:48:21.327 INFO:teuthology.orchestra.run.trial163.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:48:21.328 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:48:21.511 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:48:21.530 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:48:21.530 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:48:21.531 DEBUG:teuthology.orchestra.run.trial089:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:48:21.531 DEBUG:teuthology.orchestra.run.trial163:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:48:21.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:48:21.547 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:48:21.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:48:21.547 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:48:21.604 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:21.604 INFO:teuthology.task.kernel:Running kernel on trial163: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:21.604 DEBUG:teuthology.orchestra.run.trial163:> sudo yum install -y kernel 2026-02-12T22:48:21.605 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:21.605 INFO:teuthology.task.kernel:Running kernel on trial089: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:21.605 DEBUG:teuthology.orchestra.run.trial089:> sudo yum install -y kernel 2026-02-12T22:48:22.091 INFO:teuthology.orchestra.run.trial163.stdout:Rocky Linux 10 - AppStream 25 MB/s | 2.2 MB 00:00 2026-02-12T22:48:22.093 INFO:teuthology.orchestra.run.trial089.stdout:Rocky Linux 10 - AppStream 25 MB/s | 2.2 MB 00:00 2026-02-12T22:48:22.405 INFO:teuthology.orchestra.run.trial163.stdout:Rocky Linux 10 - BaseOS 59 MB/s | 11 MB 00:00 2026-02-12T22:48:22.442 INFO:teuthology.orchestra.run.trial089.stdout:Rocky Linux 10 - BaseOS 49 MB/s | 11 MB 00:00 2026-02-12T22:48:22.897 INFO:teuthology.orchestra.run.trial163.stdout:Rocky Linux 10 - CRB 6.4 MB/s | 507 kB 00:00 2026-02-12T22:48:22.935 INFO:teuthology.orchestra.run.trial089.stdout:Rocky Linux 10 - CRB 6.4 MB/s | 507 kB 00:00 2026-02-12T22:48:23.183 INFO:teuthology.orchestra.run.trial163.stdout:Extra Packages for Enterprise Linux 26 MB/s | 6.2 MB 00:00 2026-02-12T22:48:23.833 INFO:teuthology.orchestra.run.trial163.stdout:lab-extras 296 kB/s | 3.7 kB 00:00 2026-02-12T22:48:24.183 INFO:teuthology.orchestra.run.trial089.stdout:Extra Packages for Enterprise Linux 5.2 MB/s | 6.2 MB 00:01 2026-02-12T22:48:24.241 INFO:teuthology.orchestra.run.trial163.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:48:24.252 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-12T22:48:24.253 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-12T22:48:24.253 INFO:teuthology.orchestra.run.trial163.stdout: Package Arch Version Repo Size 2026-02-12T22:48:24.254 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-12T22:48:24.254 INFO:teuthology.orchestra.run.trial163.stdout:Installing: 2026-02-12T22:48:24.254 INFO:teuthology.orchestra.run.trial163.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:48:24.254 INFO:teuthology.orchestra.run.trial163.stdout:Installing dependencies: 2026-02-12T22:48:24.254 INFO:teuthology.orchestra.run.trial163.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:48:24.254 INFO:teuthology.orchestra.run.trial163.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:48:24.254 INFO:teuthology.orchestra.run.trial163.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:48:24.254 INFO:teuthology.orchestra.run.trial163.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:48:24.254 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-12T22:48:24.254 INFO:teuthology.orchestra.run.trial163.stdout:Transaction Summary 2026-02-12T22:48:24.254 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-12T22:48:24.255 INFO:teuthology.orchestra.run.trial163.stdout:Install 5 Packages 2026-02-12T22:48:24.255 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-12T22:48:24.255 INFO:teuthology.orchestra.run.trial163.stdout:Total download size: 93 M 2026-02-12T22:48:24.255 INFO:teuthology.orchestra.run.trial163.stdout:Installed size: 135 M 2026-02-12T22:48:24.256 INFO:teuthology.orchestra.run.trial163.stdout:Downloading Packages: 2026-02-12T22:48:24.310 INFO:teuthology.orchestra.run.trial163.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 25 MB/s | 1.4 MB 00:00 2026-02-12T22:48:24.723 INFO:teuthology.orchestra.run.trial163.stdout:(2/5): kernel-modules-core-6.12.0-124.31.1.el10 72 MB/s | 30 MB 00:00 2026-02-12T22:48:24.775 INFO:teuthology.orchestra.run.trial163.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 54 MB/s | 2.8 MB 00:00 2026-02-12T22:48:24.843 INFO:teuthology.orchestra.run.trial089.stdout:lab-extras 300 kB/s | 3.7 kB 00:00 2026-02-12T22:48:24.912 INFO:teuthology.orchestra.run.trial163.stdout:(4/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 62 MB/s | 41 MB 00:00 2026-02-12T22:48:25.200 INFO:teuthology.orchestra.run.trial163.stdout:(5/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 19 MB/s | 18 MB 00:00 2026-02-12T22:48:25.201 INFO:teuthology.orchestra.run.trial163.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:48:25.201 INFO:teuthology.orchestra.run.trial163.stdout:Total 98 MB/s | 93 MB 00:00 2026-02-12T22:48:25.201 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction check 2026-02-12T22:48:25.250 INFO:teuthology.orchestra.run.trial089.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:48:25.262 INFO:teuthology.orchestra.run.trial089.stdout:Dependencies resolved. 2026-02-12T22:48:25.263 INFO:teuthology.orchestra.run.trial089.stdout:================================================================================ 2026-02-12T22:48:25.263 INFO:teuthology.orchestra.run.trial089.stdout: Package Arch Version Repo Size 2026-02-12T22:48:25.263 INFO:teuthology.orchestra.run.trial089.stdout:================================================================================ 2026-02-12T22:48:25.264 INFO:teuthology.orchestra.run.trial089.stdout:Installing: 2026-02-12T22:48:25.264 INFO:teuthology.orchestra.run.trial089.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:48:25.264 INFO:teuthology.orchestra.run.trial089.stdout:Installing dependencies: 2026-02-12T22:48:25.264 INFO:teuthology.orchestra.run.trial089.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:48:25.264 INFO:teuthology.orchestra.run.trial089.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:48:25.264 INFO:teuthology.orchestra.run.trial089.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:48:25.264 INFO:teuthology.orchestra.run.trial089.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:48:25.264 INFO:teuthology.orchestra.run.trial089.stdout: 2026-02-12T22:48:25.264 INFO:teuthology.orchestra.run.trial089.stdout:Transaction Summary 2026-02-12T22:48:25.264 INFO:teuthology.orchestra.run.trial089.stdout:================================================================================ 2026-02-12T22:48:25.264 INFO:teuthology.orchestra.run.trial089.stdout:Install 5 Packages 2026-02-12T22:48:25.265 INFO:teuthology.orchestra.run.trial089.stdout: 2026-02-12T22:48:25.265 INFO:teuthology.orchestra.run.trial089.stdout:Total download size: 93 M 2026-02-12T22:48:25.265 INFO:teuthology.orchestra.run.trial089.stdout:Installed size: 135 M 2026-02-12T22:48:25.265 INFO:teuthology.orchestra.run.trial089.stdout:Downloading Packages: 2026-02-12T22:48:25.313 INFO:teuthology.orchestra.run.trial089.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 29 MB/s | 1.4 MB 00:00 2026-02-12T22:48:25.348 INFO:teuthology.orchestra.run.trial163.stdout:Transaction check succeeded. 2026-02-12T22:48:25.349 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction test 2026-02-12T22:48:25.533 INFO:teuthology.orchestra.run.trial089.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 68 MB/s | 18 MB 00:00 2026-02-12T22:48:25.575 INFO:teuthology.orchestra.run.trial089.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 68 MB/s | 2.8 MB 00:00 2026-02-12T22:48:25.651 INFO:teuthology.orchestra.run.trial089.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 87 MB/s | 30 MB 00:00 2026-02-12T22:48:25.751 INFO:teuthology.orchestra.run.trial163.stdout:Transaction test succeeded. 2026-02-12T22:48:25.752 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction 2026-02-12T22:48:25.802 INFO:teuthology.orchestra.run.trial089.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 75 MB/s | 41 MB 00:00 2026-02-12T22:48:25.803 INFO:teuthology.orchestra.run.trial089.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:48:25.803 INFO:teuthology.orchestra.run.trial089.stdout:Total 172 MB/s | 93 MB 00:00 2026-02-12T22:48:25.804 INFO:teuthology.orchestra.run.trial089.stdout:Running transaction check 2026-02-12T22:48:25.950 INFO:teuthology.orchestra.run.trial089.stdout:Transaction check succeeded. 2026-02-12T22:48:25.950 INFO:teuthology.orchestra.run.trial089.stdout:Running transaction test 2026-02-12T22:48:26.353 INFO:teuthology.orchestra.run.trial089.stdout:Transaction test succeeded. 2026-02-12T22:48:26.353 INFO:teuthology.orchestra.run.trial089.stdout:Running transaction 2026-02-12T22:48:26.445 INFO:teuthology.orchestra.run.trial163.stdout: Preparing : 1/1 2026-02-12T22:48:26.647 INFO:teuthology.orchestra.run.trial163.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:48:26.668 INFO:teuthology.orchestra.run.trial163.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:48:27.046 INFO:teuthology.orchestra.run.trial089.stdout: Preparing : 1/1 2026-02-12T22:48:27.248 INFO:teuthology.orchestra.run.trial089.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:48:27.269 INFO:teuthology.orchestra.run.trial089.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:48:27.921 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:48:27.949 INFO:teuthology.orchestra.run.trial163.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:48:28.528 INFO:teuthology.orchestra.run.trial089.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:48:28.556 INFO:teuthology.orchestra.run.trial089.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:48:29.796 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:48:29.801 INFO:teuthology.orchestra.run.trial163.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:48:30.399 INFO:teuthology.orchestra.run.trial089.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:48:30.405 INFO:teuthology.orchestra.run.trial089.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:48:31.659 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:48:31.668 INFO:teuthology.orchestra.run.trial163.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:32.263 INFO:teuthology.orchestra.run.trial089.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:48:32.273 INFO:teuthology.orchestra.run.trial089.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:33.536 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:34.136 INFO:teuthology.orchestra.run.trial089.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:49:07.206 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:49:07.228 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:49:07.458 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:49:07.458 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-12T22:49:07.458 INFO:teuthology.orchestra.run.trial163.stdout:Installed: 2026-02-12T22:49:07.458 INFO:teuthology.orchestra.run.trial163.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.458 INFO:teuthology.orchestra.run.trial163.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.458 INFO:teuthology.orchestra.run.trial163.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.458 INFO:teuthology.orchestra.run.trial163.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.459 INFO:teuthology.orchestra.run.trial163.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.459 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-12T22:49:07.459 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-12T22:49:07.520 DEBUG:teuthology.orchestra.run.trial163:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:49:07.594 INFO:teuthology.orchestra.run.trial163.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.594 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.594 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.595 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:49:07.595 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:49:07.595 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:49:07.595 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial163.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:49:07.595 DEBUG:teuthology.orchestra.run.trial163:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:49:07.668 INFO:teuthology.orchestra.run.trial163.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.669 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.669 DEBUG:teuthology.orchestra.run.trial163:> sudo rpm -qi grub2-tools 2026-02-12T22:49:07.740 INFO:teuthology.orchestra.run.trial163.stdout:Name : grub2-tools 2026-02-12T22:49:07.740 INFO:teuthology.orchestra.run.trial163.stdout:Epoch : 1 2026-02-12T22:49:07.740 INFO:teuthology.orchestra.run.trial163.stdout:Version : 2.12 2026-02-12T22:49:07.740 INFO:teuthology.orchestra.run.trial163.stdout:Release : 29.el10_1 2026-02-12T22:49:07.740 INFO:teuthology.orchestra.run.trial163.stdout:Architecture: x86_64 2026-02-12T22:49:07.741 INFO:teuthology.orchestra.run.trial163.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:49:07.741 INFO:teuthology.orchestra.run.trial163.stdout:Group : Unspecified 2026-02-12T22:49:07.741 INFO:teuthology.orchestra.run.trial163.stdout:Size : 7963769 2026-02-12T22:49:07.741 INFO:teuthology.orchestra.run.trial163.stdout:License : GPL-3.0-or-later 2026-02-12T22:49:07.741 INFO:teuthology.orchestra.run.trial163.stdout:Signature : 2026-02-12T22:49:07.741 INFO:teuthology.orchestra.run.trial163.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:49:07.741 INFO:teuthology.orchestra.run.trial163.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:49:07.741 INFO:teuthology.orchestra.run.trial163.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:49:07.741 INFO:teuthology.orchestra.run.trial163.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:49:07.741 INFO:teuthology.orchestra.run.trial163.stdout:Packager : Release Engineering 2026-02-12T22:49:07.742 INFO:teuthology.orchestra.run.trial163.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:49:07.742 INFO:teuthology.orchestra.run.trial163.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:49:07.742 INFO:teuthology.orchestra.run.trial163.stdout:Summary : Support tools for GRUB. 2026-02-12T22:49:07.742 INFO:teuthology.orchestra.run.trial163.stdout:Description : 2026-02-12T22:49:07.742 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-12T22:49:07.742 INFO:teuthology.orchestra.run.trial163.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:49:07.742 INFO:teuthology.orchestra.run.trial163.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:49:07.742 INFO:teuthology.orchestra.run.trial163.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:49:07.742 INFO:teuthology.orchestra.run.trial163.stdout:hardware devices. 2026-02-12T22:49:07.743 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-12T22:49:07.743 INFO:teuthology.orchestra.run.trial163.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:49:07.744 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:49:07.744 INFO:teuthology.task.kernel:Updating grub on trial163 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.744 DEBUG:teuthology.orchestra.run.trial163:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:49:07.759 INFO:teuthology.orchestra.run.trial089.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:49:07.782 INFO:teuthology.orchestra.run.trial089.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:49:07.809 INFO:teuthology.orchestra.run.trial163.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:49:07.811 DEBUG:teuthology.orchestra.run.trial163:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:49:07.876 INFO:teuthology.orchestra.run.trial163.stdout:/sbin/grubby 2026-02-12T22:49:07.877 INFO:teuthology.orchestra.run.trial163.stdout:yes 2026-02-12T22:49:07.878 DEBUG:teuthology.orchestra.run.trial163:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:49:07.945 INFO:teuthology.orchestra.run.trial163.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:49:07.945 DEBUG:teuthology.orchestra.run.trial163:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.016 INFO:teuthology.orchestra.run.trial089.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:49:08.016 INFO:teuthology.orchestra.run.trial089.stdout: 2026-02-12T22:49:08.016 INFO:teuthology.orchestra.run.trial089.stdout:Installed: 2026-02-12T22:49:08.016 INFO:teuthology.orchestra.run.trial089.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.016 INFO:teuthology.orchestra.run.trial089.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.017 INFO:teuthology.orchestra.run.trial089.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.017 INFO:teuthology.orchestra.run.trial089.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.017 INFO:teuthology.orchestra.run.trial089.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.017 INFO:teuthology.orchestra.run.trial089.stdout: 2026-02-12T22:49:08.017 INFO:teuthology.orchestra.run.trial089.stdout:Complete! 2026-02-12T22:49:08.024 DEBUG:teuthology.orchestra.run.trial163:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:49:08.080 DEBUG:teuthology.orchestra.run.trial089:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:49:08.115 INFO:teuthology.orchestra.run.trial089.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.115 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.115 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.116 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:49:08.116 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:49:08.116 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:49:08.116 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial089.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:49:08.116 DEBUG:teuthology.orchestra.run.trial089:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:49:08.136 INFO:teuthology.orchestra.run.trial163.stderr:Generating grub configuration file ... 2026-02-12T22:49:08.188 INFO:teuthology.orchestra.run.trial089.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.189 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.189 DEBUG:teuthology.orchestra.run.trial089:> sudo rpm -qi grub2-tools 2026-02-12T22:49:08.260 INFO:teuthology.orchestra.run.trial089.stdout:Name : grub2-tools 2026-02-12T22:49:08.260 INFO:teuthology.orchestra.run.trial089.stdout:Epoch : 1 2026-02-12T22:49:08.260 INFO:teuthology.orchestra.run.trial089.stdout:Version : 2.12 2026-02-12T22:49:08.260 INFO:teuthology.orchestra.run.trial089.stdout:Release : 29.el10_1 2026-02-12T22:49:08.261 INFO:teuthology.orchestra.run.trial089.stdout:Architecture: x86_64 2026-02-12T22:49:08.261 INFO:teuthology.orchestra.run.trial089.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:49:08.261 INFO:teuthology.orchestra.run.trial089.stdout:Group : Unspecified 2026-02-12T22:49:08.261 INFO:teuthology.orchestra.run.trial089.stdout:Size : 7963769 2026-02-12T22:49:08.261 INFO:teuthology.orchestra.run.trial089.stdout:License : GPL-3.0-or-later 2026-02-12T22:49:08.261 INFO:teuthology.orchestra.run.trial089.stdout:Signature : 2026-02-12T22:49:08.261 INFO:teuthology.orchestra.run.trial089.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:49:08.261 INFO:teuthology.orchestra.run.trial089.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:49:08.261 INFO:teuthology.orchestra.run.trial089.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:49:08.261 INFO:teuthology.orchestra.run.trial089.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:49:08.261 INFO:teuthology.orchestra.run.trial089.stdout:Packager : Release Engineering 2026-02-12T22:49:08.262 INFO:teuthology.orchestra.run.trial089.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:49:08.262 INFO:teuthology.orchestra.run.trial089.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:49:08.262 INFO:teuthology.orchestra.run.trial089.stdout:Summary : Support tools for GRUB. 2026-02-12T22:49:08.262 INFO:teuthology.orchestra.run.trial089.stdout:Description : 2026-02-12T22:49:08.262 INFO:teuthology.orchestra.run.trial089.stdout: 2026-02-12T22:49:08.262 INFO:teuthology.orchestra.run.trial089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:49:08.262 INFO:teuthology.orchestra.run.trial089.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:49:08.262 INFO:teuthology.orchestra.run.trial089.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:49:08.262 INFO:teuthology.orchestra.run.trial089.stdout:hardware devices. 2026-02-12T22:49:08.262 INFO:teuthology.orchestra.run.trial089.stdout: 2026-02-12T22:49:08.262 INFO:teuthology.orchestra.run.trial089.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:49:08.264 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:49:08.264 INFO:teuthology.task.kernel:Updating grub on trial089 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.264 DEBUG:teuthology.orchestra.run.trial089:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:49:08.309 INFO:teuthology.orchestra.run.trial163.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:49:08.319 INFO:teuthology.orchestra.run.trial163.stderr:done 2026-02-12T22:49:08.321 DEBUG:teuthology.orchestra.run.trial163:> test -d /sys/firmware/efi 2026-02-12T22:49:08.329 INFO:teuthology.orchestra.run.trial089.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:49:08.331 DEBUG:teuthology.orchestra.run.trial089:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:49:08.338 DEBUG:teuthology.orchestra.run.trial163:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:49:08.396 INFO:teuthology.orchestra.run.trial089.stdout:/sbin/grubby 2026-02-12T22:49:08.397 INFO:teuthology.orchestra.run.trial089.stdout:yes 2026-02-12T22:49:08.398 DEBUG:teuthology.orchestra.run.trial089:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:49:08.409 INFO:teuthology.orchestra.run.trial163.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:49:08.409 INFO:teuthology.orchestra.run.trial163.stdout:/boot/efi/EFI/rocky 2026-02-12T22:49:08.410 DEBUG:teuthology.orchestra.run.trial163:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:49:08.463 INFO:teuthology.orchestra.run.trial089.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:49:08.465 DEBUG:teuthology.orchestra.run.trial089:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.478 INFO:teuthology.orchestra.run.trial163.stdout:no 2026-02-12T22:49:08.478 DEBUG:teuthology.orchestra.run.trial163:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:49:08.541 DEBUG:teuthology.orchestra.run.trial089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:49:08.545 INFO:teuthology.orchestra.run.trial163.stdout:yes 2026-02-12T22:49:08.546 DEBUG:teuthology.orchestra.run.trial163:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:49:08.612 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial163 2026-02-12T22:49:08.613 DEBUG:teuthology.orchestra.run.trial163:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:49:08.653 INFO:teuthology.orchestra.run.trial089.stderr:Generating grub configuration file ... 2026-02-12T22:49:08.678 INFO:teuthology.orchestra.run.trial163.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:49:08.832 INFO:teuthology.orchestra.run.trial089.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:49:08.842 INFO:teuthology.orchestra.run.trial089.stderr:done 2026-02-12T22:49:08.844 DEBUG:teuthology.orchestra.run.trial089:> test -d /sys/firmware/efi 2026-02-12T22:49:08.861 DEBUG:teuthology.orchestra.run.trial089:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:49:08.933 INFO:teuthology.orchestra.run.trial089.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:49:08.933 INFO:teuthology.orchestra.run.trial089.stdout:/boot/efi/EFI/rocky 2026-02-12T22:49:08.934 DEBUG:teuthology.orchestra.run.trial089:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:49:09.000 INFO:teuthology.orchestra.run.trial089.stdout:no 2026-02-12T22:49:09.000 DEBUG:teuthology.orchestra.run.trial089:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:49:09.068 INFO:teuthology.orchestra.run.trial089.stdout:yes 2026-02-12T22:49:09.069 DEBUG:teuthology.orchestra.run.trial089:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:49:09.134 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial089 2026-02-12T22:49:09.134 DEBUG:teuthology.orchestra.run.trial089:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:49:09.198 INFO:teuthology.orchestra.run.trial089.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:49:38.655 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:38.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:38.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:38.769 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:38.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:38.853 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:38.853 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:38.910 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:38.911 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:38.911 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:38.911 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:39.177 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:39.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:39.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:39.288 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:39.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:39.376 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:39.377 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:39.434 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:39.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:39.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:39.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:39.913 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:39.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:39.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:40.025 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:40.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:40.101 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:40.101 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:40.158 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:40.159 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:40.159 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:40.159 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:40.436 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:40.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:40.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:40.546 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:40.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:40.628 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:40.628 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:40.685 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:40.686 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:40.686 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:40.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:41.160 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:41.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:41.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:41.271 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:41.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:41.350 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:41.350 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:41.408 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:41.408 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:41.408 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:41.408 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:41.687 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:41.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:41.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:41.795 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:41.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:41.874 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:41.874 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:41.930 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:41.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:41.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:41.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:42.410 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:42.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:42.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:42.541 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:42.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:42.627 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:42.628 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:42.685 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:42.685 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:42.685 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:42.685 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:42.931 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:42.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:42.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:43.039 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:43.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:43.131 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:43.131 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:43.188 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:43.188 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:43.189 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:43.189 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:43.686 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:43.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:43.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:43.808 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:43.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:43.886 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:43.886 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:43.943 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:43.943 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:43.943 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:43.943 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:44.189 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:44.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:44.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:44.298 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:44.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:44.384 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:44.384 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:44.441 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:44.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:44.441 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:44.441 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:44.944 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:44.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:44.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:45.087 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:45.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:45.178 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:45.178 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:45.236 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:45.236 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:45.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:45.236 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:45.442 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:45.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:45.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:45.549 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:45.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:45.633 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:45.633 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:45.690 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:45.690 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:45.691 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:45.691 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:46.237 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:46.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:46.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:46.348 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:46.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:46.434 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:46.434 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:46.491 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:46.492 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:46.492 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:46.492 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:46.692 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:46.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:46.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:46.800 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:46.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:46.890 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:46.890 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:46.947 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:46.947 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:46.947 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:46.948 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:47.493 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:47.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:47.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:47.605 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:47.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:47.693 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:47.693 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:47.751 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:47.751 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:47.751 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:47.751 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:47.949 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:47.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:47.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:48.058 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:48.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:48.138 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:48.139 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:48.195 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:48.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:48.196 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:48.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:48.753 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:48.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:48.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:48.863 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:48.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:48.936 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:48.936 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:48.994 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:48.995 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:48.995 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:48.995 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:49.197 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:49.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:49.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:49.305 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:49.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:49.389 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:49.390 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:49.447 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:49.448 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:49.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:49.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:49.996 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:49.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:49.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:50.109 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:50.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:50.190 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:50.190 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:50.249 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:50.249 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:50.249 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:50.249 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:50.450 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:50.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:50.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:50.559 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:50.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:50.637 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:50.637 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:50.694 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:50.694 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:50.694 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:50.695 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:51.251 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:51.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:51.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:51.362 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:51.442 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:51.443 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:51.443 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:51.499 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:51.499 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:51.500 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:51.500 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:51.696 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:51.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:51.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:51.804 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:51.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:51.892 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:51.892 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:51.949 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:51.950 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:51.950 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:51.950 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:52.501 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:52.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:52.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:52.612 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:52.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:52.697 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:52.697 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:52.755 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:52.756 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:52.756 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:52.756 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:52.951 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:52.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:52.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:53.058 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:53.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:53.141 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:53.141 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:53.198 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:53.198 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:53.198 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:53.198 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:53.757 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:53.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:53.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:53.868 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:53.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:53.944 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:53.944 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:54.002 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:54.002 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:54.002 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:54.002 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:54.200 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:54.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:54.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:54.307 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:54.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:54.390 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:54.390 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:54.447 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:54.448 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:54.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:54.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:55.003 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:55.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:55.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:55.114 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:55.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:55.189 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:55.189 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:55.246 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:55.246 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:55.247 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:55.247 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:55.449 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:55.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:55.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:55.557 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:55.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:55.646 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:55.646 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:55.704 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:55.704 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:55.704 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:55.704 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:56.248 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:56.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:56.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:56.358 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:56.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:56.438 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:56.438 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:56.495 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:56.495 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:56.495 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:56.495 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:56.706 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:56.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:56.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:56.814 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:56.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:56.888 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:56.888 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:56.945 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:56.945 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:56.945 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:56.945 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:57.497 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:57.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:57.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:57.609 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:57.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:57.688 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:57.688 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:57.745 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:57.745 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:57.745 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:57.745 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:57.947 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:57.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:57.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:58.056 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:58.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:58.137 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:58.137 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:58.194 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:58.194 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:58.194 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:58.195 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:58.747 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:58.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:58.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:58.882 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:49:58.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:49:58.960 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:58.960 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:49:59.017 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:59.017 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:59.017 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:59.017 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:59.196 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:59.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:59.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:59.307 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:49:59.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:49:59.398 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:59.398 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:49:59.454 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:59.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:59.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:59.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:00.018 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:00.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:00.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:00.157 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:00.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:00.238 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:00.238 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:00.295 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:00.295 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:00.295 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:00.296 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:00.456 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:00.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:00.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:00.565 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:00.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:00.657 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:00.657 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:00.714 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:00.714 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:00.714 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:00.714 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:01.297 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:01.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:01.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:01.409 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:01.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:01.508 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:01.508 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:01.567 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:01.567 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:01.567 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:01.567 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:01.715 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:01.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:01.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:01.823 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:01.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:01.907 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:01.907 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:01.964 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:01.965 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:01.965 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:01.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:02.568 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:02.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:02.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:02.636 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:02.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:02.710 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:02.710 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:02.767 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:02.767 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:02.768 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:02.768 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:02.966 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:02.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:02.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:03.074 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:03.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:03.149 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:03.149 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:03.206 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:03.206 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:03.206 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:03.206 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:03.769 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:03.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:03.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:03.842 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:03.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:03.917 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:03.917 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:03.975 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:03.975 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:03.976 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:03.976 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:04.208 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:04.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:04.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:04.316 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:04.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:04.399 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:04.399 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:04.455 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:04.456 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:04.456 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:04.456 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:04.977 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:04.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:04.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:05.048 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:05.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:05.121 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:05.121 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:05.179 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:05.179 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:05.179 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:05.179 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:05.457 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:05.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:05.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:05.565 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:05.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:05.640 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:05.640 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:05.697 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:05.697 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:05.697 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:05.698 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:06.180 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:06.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:06.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:06.257 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:06.342 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:06.342 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:06.342 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:06.398 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:06.399 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:06.399 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:06.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:06.699 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:06.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:06.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:06.807 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:06.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:06.886 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:06.886 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:06.943 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:06.943 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:06.943 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:06.943 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:07.399 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:07.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:07.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:07.513 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:07.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:07.597 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:07.597 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:07.653 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:07.653 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:07.654 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:07.654 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:07.945 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:07.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:07.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:08.053 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:08.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:08.138 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:08.139 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:08.196 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:08.197 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:08.197 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:08.197 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:08.655 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:08.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:08.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:08.766 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:08.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:08.847 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:08.847 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:08.904 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:08.904 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:08.904 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:08.904 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:09.198 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:09.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:09.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:09.307 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:09.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:09.382 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:09.382 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:09.439 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:09.440 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:09.440 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:09.440 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:09.905 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:09.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:09.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:10.017 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:10.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:10.090 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:10.090 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:10.147 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:10.147 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:10.148 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:10.148 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:10.442 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:10.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:10.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:10.551 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:10.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:10.638 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:10.638 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:10.695 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:10.695 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:10.696 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:10.696 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:11.149 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:11.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:11.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:11.263 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:11.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:11.354 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:11.354 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:11.413 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:11.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:11.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:11.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:11.697 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:11.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:11.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:11.803 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:11.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:11.888 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:11.888 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:11.946 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:11.947 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:11.947 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:11.947 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:12.414 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:12.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:12.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:12.488 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:12.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:12.569 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:12.569 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:12.626 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:12.626 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:12.626 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:12.627 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:12.948 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:12.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:12.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:13.058 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:13.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:13.134 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:13.135 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:13.192 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:13.192 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:13.192 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:13.192 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:13.628 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:13.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:13.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:13.739 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:13.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:13.810 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:13.810 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:13.868 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:13.868 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:13.869 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:13.869 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:14.194 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:14.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:14.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:14.302 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:14.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:14.378 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:14.378 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:14.435 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:14.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:14.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:14.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:14.870 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:14.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:14.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:14.981 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:15.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:15.064 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:15.064 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:15.121 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:15.121 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:15.121 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:15.121 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:15.436 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:15.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:15.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:15.543 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:15.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:15.628 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:15.628 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:15.685 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:15.685 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:15.685 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:15.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:16.122 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:16.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:16.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:16.214 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:16.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:16.289 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:16.289 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:16.346 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:16.346 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:16.346 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:16.347 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:16.686 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:16.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:16.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:16.794 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:16.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:16.878 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:16.878 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:16.935 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:16.935 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:16.935 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:16.936 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:17.348 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:17.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:17.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:17.418 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:17.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:17.494 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:17.495 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:17.552 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:17.553 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:17.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:17.553 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:17.937 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:17.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:17.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:18.045 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:18.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:18.125 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:18.125 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:18.182 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:18.183 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:18.183 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:18.183 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:18.554 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:18.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:18.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:18.626 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:18.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:18.717 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:18.717 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:18.773 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:18.773 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:18.773 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:18.773 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:19.184 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:19.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:19.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:19.292 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:19.373 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:19.373 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:19.374 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:19.431 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:19.431 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:19.432 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:19.432 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:19.774 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:19.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:19.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:19.866 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:19.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:19.943 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:19.943 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:20.001 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:20.002 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:20.002 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:20.002 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:20.433 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:20.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:20.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:20.543 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:20.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:20.627 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:20.627 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:20.684 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:20.684 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:20.684 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:20.685 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:21.004 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:21.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:21.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:21.114 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:21.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:21.190 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:21.190 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:21.247 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:21.248 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:21.248 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:21.248 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:21.686 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:21.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:21.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:21.796 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:21.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:21.869 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:21.869 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:21.926 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:21.926 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:21.926 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:21.927 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:22.250 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:22.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:22.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:22.346 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:22.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:22.418 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:22.418 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:22.474 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:22.475 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:22.475 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:22.475 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:22.928 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:22.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:22.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:23.037 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:23.119 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:23.119 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:23.119 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:23.175 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:23.176 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:23.176 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:23.176 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:23.476 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:23.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:23.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:23.588 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:23.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:23.670 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:23.671 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:23.728 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:23.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:23.728 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:23.728 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:24.177 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:24.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:24.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:24.286 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:24.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:24.362 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:24.362 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:24.419 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:24.419 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:24.419 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:24.419 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:24.729 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:24.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:24.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:24.840 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:24.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:24.919 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:24.919 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:24.978 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:24.978 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:24.978 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:24.978 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:25.420 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:25.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:25.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:25.526 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:25.614 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:25.614 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:25.614 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:25.671 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:25.671 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:25.671 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:25.672 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:25.980 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:25.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:25.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:26.091 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:26.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:26.162 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:26.163 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:26.221 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:26.221 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:26.221 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:26.221 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:26.673 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:26.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:26.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:26.782 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:26.855 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:26.855 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:26.855 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:26.911 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:26.912 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:26.912 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:26.912 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:27.222 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:27.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:27.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:27.333 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:27.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:27.412 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:27.412 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:27.471 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:27.472 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.472 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:27.472 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:27.913 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:27.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:27.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:28.022 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:28.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:28.094 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:28.094 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:28.151 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:28.151 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:28.151 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:28.151 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:28.473 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:28.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:28.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:28.584 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:28.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:28.664 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:28.664 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:28.721 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:28.721 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:28.721 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:28.721 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:29.153 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:29.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:29.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:29.261 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:29.342 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:29.342 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:29.342 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:29.399 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:29.399 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:29.400 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:29.400 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:29.722 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:29.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:29.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:29.833 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:29.906 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:29.906 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:29.906 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:29.964 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:29.964 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:29.965 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:29.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:30.401 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:30.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:30.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:30.509 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:30.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:30.595 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:30.595 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:30.652 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:30.652 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:30.652 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:30.652 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:30.966 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:30.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:30.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:31.067 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:31.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:31.155 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:31.155 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:31.212 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:31.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:31.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:31.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:31.653 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:31.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:31.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:31.761 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:31.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:31.840 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:31.840 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:31.898 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:31.898 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:31.898 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:31.898 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:32.213 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:32.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:32.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:32.277 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:32.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:32.365 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:32.365 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:32.421 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:32.421 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:32.422 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:32.422 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:32.900 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:32.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:32.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:33.000 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:33.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:33.079 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:33.079 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:33.136 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:33.136 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:33.136 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:33.136 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:33.422 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:33.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:33.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:33.486 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:33.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:33.568 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:33.568 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:33.624 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:33.625 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:33.625 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:33.625 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:34.137 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:34.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:34.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:34.197 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:34.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:34.279 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:34.279 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:34.336 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:34.336 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:34.336 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:34.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:34.626 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:34.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:34.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:34.689 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:34.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:34.764 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:34.764 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:34.822 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:34.822 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:34.822 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:34.822 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:35.337 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:35.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:35.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:35.444 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:35.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:35.535 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:35.535 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:35.591 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:35.591 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:35.591 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:35.591 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:35.823 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:35.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:35.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:35.935 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:36.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:36.020 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:36.020 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:36.078 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:36.078 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:36.079 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:36.079 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:36.591 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:36.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:36.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:36.654 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:36.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:36.738 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:36.738 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:36.794 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:36.795 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:36.795 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:36.795 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:37.080 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:37.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:37.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:37.192 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:37.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:37.269 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:37.269 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:37.327 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:37.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:37.327 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:37.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:37.796 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:37.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:37.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:37.894 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:37.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:37.979 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:37.979 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:38.035 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:38.035 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:38.035 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:38.036 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:38.328 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:38.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:38.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:38.391 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:38.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:38.463 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:38.463 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:38.520 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:38.520 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:38.520 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:38.520 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:39.036 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:39.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:39.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:39.099 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:39.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:39.180 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:39.180 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:39.236 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:39.237 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:39.237 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:39.237 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:39.520 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:39.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:39.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:39.608 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:39.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:39.695 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:39.695 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:39.752 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:39.752 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:39.752 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:39.752 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:40.238 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:40.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:40.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:40.347 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:40.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:40.430 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:40.430 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:40.488 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:40.489 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:40.489 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:40.489 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:40.754 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:40.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:40.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:40.885 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:40.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:40.960 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:40.960 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:41.018 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:41.019 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:41.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:41.019 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:41.490 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:41.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:41.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:41.597 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:41.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:41.675 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:41.675 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:41.731 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:41.732 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:41.732 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:41.732 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:42.020 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:42.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:42.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:42.100 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:42.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:42.185 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:42.186 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:42.244 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:42.244 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:42.244 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:42.244 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:42.734 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:42.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:42.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:42.843 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:42.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:42.923 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:42.923 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:42.980 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:42.980 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:42.980 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:42.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:43.246 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:43.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:43.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:43.356 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:43.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:43.446 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:43.446 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:43.502 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:43.503 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:43.503 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:43.503 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:43.981 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:43.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:43.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:44.089 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:44.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:44.172 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:44.172 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:44.228 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:44.229 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:44.229 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:44.229 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:44.505 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:44.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:44.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:44.616 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:44.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:44.694 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:44.694 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:44.750 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:44.750 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:44.751 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:44.751 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:45.230 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:45.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:45.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:45.338 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:45.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:45.418 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:45.418 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:45.474 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:45.475 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:45.475 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:45.475 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:45.752 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:45.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:45.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:45.854 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:45.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:45.934 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:45.934 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:45.991 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:45.991 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:45.991 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:45.991 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:46.477 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:46.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:46.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:46.585 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:46.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:46.657 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:46.657 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:46.714 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:46.714 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:46.714 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:46.714 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:46.992 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:46.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:46.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:47.102 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:47.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:47.182 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:47.182 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:47.238 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:47.238 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:47.238 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:47.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:47.715 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:47.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:47.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:47.823 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:47.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:47.902 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:47.902 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:47.959 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:47.959 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:47.959 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:47.959 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:48.239 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:48.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:48.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:48.350 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:48.425 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:48.426 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:48.426 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:48.482 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:48.482 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:48.483 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:48.483 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:48.961 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:48.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:48.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:49.070 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:49.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:49.154 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:49.154 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:49.210 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:49.211 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:49.211 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:49.211 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:49.484 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:49.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:49.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:49.594 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:49.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:49.678 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:49.678 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:49.735 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:49.735 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:49.735 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:49.736 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:50.213 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:50.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:50.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:50.321 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:50.401 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:50.401 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:50.401 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:50.458 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:50.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:50.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:50.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:50.736 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:50.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:50.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:50.848 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:50.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:50.933 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:50.933 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:50.990 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:50.991 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:50.991 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:50.991 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:51.460 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:51.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:51.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:51.569 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:51.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:51.646 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:51.646 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:51.703 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:51.704 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:51.704 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:51.704 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:51.992 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:51.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:51.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:52.097 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:52.179 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:52.179 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:52.179 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:52.236 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:52.237 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:52.237 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:52.237 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:52.705 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:52.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:52.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:52.813 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:52.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:52.886 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:52.886 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:52.945 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:52.945 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:52.946 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:52.946 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:53.239 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:53.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:53.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:53.345 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:53.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:53.431 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:53.431 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:53.487 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:53.488 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:53.488 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:53.488 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:53.947 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:53.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:53.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:54.056 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:54.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:54.137 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:54.137 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:54.195 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:54.195 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:54.195 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:54.195 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:54.489 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:54.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:54.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:54.600 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:54.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:54.673 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:54.674 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:54.730 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:54.731 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:54.731 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:54.731 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:55.196 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:55.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:55.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:55.304 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:55.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:55.391 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:55.391 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:55.448 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:55.448 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:55.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:55.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:55.732 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:55.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:55.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:55.803 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:55.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:55.884 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:55.884 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:55.941 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:55.942 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:55.942 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:55.942 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:56.450 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:56.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:56.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:56.521 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:56.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:56.602 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:56.602 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:56.659 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:56.659 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:56.660 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:56.660 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:56.944 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:56.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:56.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:57.055 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:57.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:57.129 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:57.129 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:57.186 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:57.186 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:57.186 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:57.186 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:57.661 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:57.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:57.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:57.770 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:57.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:57.852 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:57.852 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:57.908 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:57.908 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:57.908 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:57.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:58.188 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:58.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:58.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:58.298 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:58.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:58.385 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:58.385 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:58.442 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:58.442 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:58.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:58.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:58.909 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:58.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:58.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:59.025 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:50:59.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:50:59.099 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:59.099 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:50:59.156 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:59.156 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:59.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:59.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:59.444 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:59.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:59.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:59.555 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:50:59.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:50:59.629 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:59.629 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:50:59.686 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:59.687 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:59.687 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:59.687 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:00.157 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:00.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:00.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:00.265 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:00.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:00.350 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:00.350 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:00.407 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:00.407 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:00.407 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:00.408 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:00.688 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:00.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:00.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:00.799 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:00.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:00.880 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:00.880 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:00.937 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:00.937 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:00.938 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:00.938 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:01.409 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:01.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:01.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:01.517 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:01.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:01.595 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:01.595 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:01.652 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:01.653 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:01.653 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:01.653 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:01.939 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:01.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:01.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:02.051 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:02.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:02.130 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:02.130 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:02.188 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:02.188 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:02.188 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:02.189 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:02.654 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:02.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:02.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:02.762 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:02.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:02.840 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:02.840 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:02.898 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:02.898 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:02.898 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:02.898 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:03.190 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:03.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:03.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:03.301 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:03.379 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:03.379 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:03.379 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:03.436 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:03.436 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:03.436 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:03.437 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:03.900 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:03.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:03.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:04.026 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:04.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:04.115 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:04.115 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:04.173 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:04.173 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:04.173 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:04.173 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:04.438 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:04.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:04.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:04.548 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:04.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:04.629 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:04.629 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:04.686 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:04.686 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:04.687 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:04.687 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:05.174 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:05.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:05.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:05.305 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:05.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:05.393 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:05.393 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:05.450 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:05.450 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:05.450 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:05.450 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:05.688 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:05.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:05.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:05.816 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:05.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:05.895 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:05.895 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:05.953 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:05.953 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:05.953 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:05.953 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:06.451 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:06.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:06.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:06.559 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:06.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:06.642 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:06.642 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:06.700 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:06.700 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:06.701 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:06.701 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:06.954 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:06.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:06.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:07.069 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:07.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:07.150 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:07.150 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:07.207 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:07.208 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:07.208 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:07.208 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:07.702 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:07.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:07.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:07.811 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:07.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:07.891 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:07.891 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:07.948 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:07.948 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:07.948 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:07.948 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:08.209 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:08.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:08.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:08.324 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:08.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:08.398 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:08.399 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:08.456 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:08.456 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:08.457 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:08.457 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:08.949 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:08.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:08.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:09.065 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:09.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:09.137 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:09.137 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:09.195 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:09.195 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:09.195 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:09.195 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:09.457 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:09.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:09.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:09.526 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:09.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:09.602 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:09.602 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:09.659 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:09.659 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:09.659 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:09.659 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:10.196 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:10.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:10.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:10.306 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:10.388 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:10.388 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:10.389 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:10.445 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:10.446 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:10.446 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:10.446 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:10.660 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:10.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:10.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:10.772 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:10.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:10.852 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:10.852 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:10.909 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:10.909 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:10.909 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:10.909 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:11.447 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:11.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:11.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:11.555 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:11.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:11.627 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:11.627 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:11.684 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:11.684 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:11.684 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:11.685 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:11.911 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:11.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:11.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:12.021 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:12.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:12.111 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:12.111 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:12.168 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:12.169 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:12.169 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:12.169 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:12.686 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:12.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:12.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:12.795 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:12.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:12.877 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:12.877 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:12.935 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:12.936 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:12.936 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:12.936 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:13.170 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:13.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:13.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:13.281 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:13.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:13.357 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:13.357 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:13.414 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:13.414 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:13.414 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:13.414 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:13.937 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:13.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:13.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:14.047 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:14.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:14.130 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:14.131 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:14.188 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:14.188 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:14.188 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:14.188 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:14.416 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:14.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:14.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:14.527 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:14.609 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:14.609 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:14.609 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:14.666 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:14.667 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:14.667 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:14.667 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:15.189 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:15.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:15.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:15.297 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:15.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:15.380 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:15.380 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:15.437 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:15.438 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:15.438 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:15.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:15.669 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:15.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:15.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:15.759 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:15.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:15.839 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:15.839 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:15.896 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:15.896 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:15.896 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:15.896 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:16.439 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:16.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:16.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:16.547 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:16.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:16.637 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:16.637 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:16.694 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:16.694 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:16.694 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:16.694 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:16.897 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:16.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:16.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:17.007 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:17.095 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:17.095 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:17.095 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:17.151 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:17.152 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:17.152 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:17.152 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:17.696 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:17.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:17.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:17.828 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:17.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:17.899 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:17.900 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:17.957 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:17.957 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:17.957 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:17.957 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:18.154 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:18.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:18.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:18.264 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:18.342 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:18.342 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:18.342 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:18.398 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:18.399 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:18.399 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:18.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:18.957 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:18.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:18.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:19.088 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:19.179 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:19.179 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:19.179 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:19.236 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:19.236 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:19.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:19.236 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:19.400 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:19.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:19.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:19.511 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:19.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:19.588 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:19.588 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:19.645 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:19.645 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:19.646 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:19.646 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:20.237 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:20.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:20.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:20.373 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:20.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:20.463 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:20.463 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:20.519 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:20.519 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.519 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:20.519 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:20.647 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:20.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:20.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:20.756 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:20.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:20.836 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:20.836 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:20.893 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:20.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:20.894 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:21.519 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:21.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:21.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:21.643 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:21.723 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:21.723 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:21.723 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:21.779 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:21.780 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:21.780 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:21.780 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:21.895 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:21.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:21.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:22.006 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:22.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:22.092 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:22.092 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:22.149 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:22.150 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:22.150 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:22.150 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:22.781 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:22.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:22.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:22.890 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:22.965 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:22.965 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:22.965 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:23.022 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:23.022 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:23.022 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:23.022 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:23.151 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:23.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:23.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:23.269 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:23.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:23.350 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:23.350 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:23.407 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:23.407 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:23.407 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:23.407 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:24.023 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:24.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:24.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:24.155 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:24.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:24.244 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:24.245 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:24.301 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:24.302 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:24.302 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:24.302 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:24.407 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:24.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:24.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:24.517 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:24.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:24.590 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:24.590 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:24.648 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:24.648 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:24.648 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:24.648 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:25.303 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:25.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:25.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:25.416 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:25.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:25.502 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:25.502 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:25.559 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:25.559 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:25.560 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:25.560 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:25.650 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:25.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:25.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:25.759 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:25.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:25.839 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:25.840 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:25.897 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:25.897 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:25.897 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:25.897 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:26.561 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:26.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:26.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:26.670 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:26.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:26.743 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:26.743 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:26.799 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:26.799 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:26.800 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:26.800 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:26.899 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:26.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:26.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:27.009 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:27.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:27.100 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:27.100 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:27.157 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:27.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:27.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:27.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:27.801 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:27.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:27.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:27.909 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:27.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:27.999 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:28.000 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:28.057 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:28.057 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:28.057 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:28.057 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:28.158 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:28.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:28.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:28.269 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:28.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:28.340 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:28.340 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:28.397 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:28.397 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:28.397 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:28.398 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:29.058 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:29.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:29.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:29.137 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:29.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:29.212 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:29.212 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:29.269 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:29.270 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:29.270 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:29.270 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:29.398 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:29.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:29.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:29.510 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:29.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:29.589 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:29.589 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:29.645 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:29.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:29.646 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:29.646 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:30.272 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:30.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:30.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:30.352 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:30.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:30.434 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:30.435 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:30.491 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:30.492 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:30.492 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:30.492 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:30.647 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:30.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:30.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:30.760 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:30.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:30.835 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:30.835 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:30.893 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:30.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:30.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:30.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:31.494 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:31.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:31.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:31.602 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:31.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:31.674 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:31.675 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:31.731 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:31.732 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:31.732 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:31.732 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:31.895 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:31.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:31.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:32.006 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:32.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:32.078 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:32.078 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:32.135 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:32.135 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:32.136 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:32.136 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:32.733 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:32.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:32.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:32.828 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:32.906 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:32.907 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:32.907 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:32.963 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:32.964 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:32.964 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:32.964 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:33.137 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:33.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:33.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:33.248 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:33.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:33.324 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:33.325 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:33.381 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:33.382 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:33.382 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:33.382 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:33.966 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:33.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:33.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:34.063 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:34.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:34.139 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:34.140 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:34.197 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:34.198 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:34.198 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:34.198 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:34.384 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:34.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:34.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:34.494 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:34.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:34.567 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:34.567 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:34.624 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:34.624 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:34.624 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:34.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:35.199 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:35.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:35.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:35.306 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:35.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:35.382 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:35.382 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:35.439 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:35.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:35.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:35.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:35.625 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:35.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:35.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:35.735 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:35.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:35.810 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:35.811 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:35.868 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:35.868 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:35.868 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:35.868 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:36.440 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:36.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:36.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:36.545 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:36.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:36.631 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:36.631 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:36.689 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:36.689 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:36.690 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:36.690 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:36.869 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:36.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:36.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:36.980 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:37.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:37.056 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:37.056 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:37.113 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:37.113 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:37.113 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:37.113 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:37.690 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:37.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:37.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:37.799 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:37.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:37.872 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:37.873 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:37.929 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:37.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:37.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:37.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:38.114 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:38.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:38.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:38.225 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:38.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:38.302 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:38.302 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:38.358 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:38.359 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:38.359 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:38.359 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:38.931 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:38.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:38.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:39.034 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:39.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:39.107 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:39.107 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:39.164 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:39.165 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:39.165 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:39.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:39.360 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:39.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:39.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:39.472 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:39.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:39.550 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:39.550 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:39.607 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:39.607 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:39.608 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:39.608 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:40.167 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:40.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:40.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:40.268 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:40.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:40.352 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:40.352 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:40.408 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:40.409 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:40.409 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:40.409 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:40.609 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:40.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:40.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:40.720 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:40.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:40.793 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:40.793 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:40.850 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:40.850 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:40.850 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:40.850 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:41.410 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:41.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:41.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:41.471 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:41.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:41.546 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:41.546 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:41.602 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:41.603 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:41.603 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:41.603 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:41.851 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:41.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:41.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:41.961 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:42.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:42.043 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:42.043 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:42.101 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:42.101 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:42.101 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:42.101 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:42.604 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:42.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:42.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:42.664 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:42.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:42.741 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:42.742 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:42.799 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:42.799 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:42.799 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:42.799 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:43.103 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:43.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:43.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:43.214 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:43.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:43.296 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:43.296 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:43.353 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:43.353 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:43.353 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:43.354 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:43.800 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:43.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:43.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:43.910 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:43.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:43.998 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:43.998 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:44.055 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:44.055 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:44.056 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:44.056 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:44.354 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:44.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:44.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:44.467 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:44.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:44.541 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:44.541 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:44.598 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:44.599 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:44.599 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:44.599 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:45.057 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:45.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:45.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:45.164 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:45.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:45.246 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:45.246 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:45.302 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:45.302 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:45.303 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:45.303 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:45.601 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:45.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:45.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:45.664 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:45.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:45.737 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:45.737 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:45.794 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:45.794 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:45.794 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:45.794 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:46.303 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:46.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:46.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:46.412 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:46.486 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:46.487 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:46.487 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:46.544 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:46.544 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:46.544 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:46.545 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:46.795 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:46.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:46.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:46.906 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:46.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:46.989 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:46.990 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:47.047 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:47.047 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:47.047 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:47.048 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:47.545 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:47.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:47.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:47.654 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:47.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:47.730 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:47.730 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:47.788 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:47.788 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:47.788 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:47.788 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:48.049 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:48.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:48.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:48.162 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:48.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:48.234 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:48.234 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:48.292 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:48.292 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:48.292 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:48.292 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:48.790 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:48.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:48.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:48.900 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:48.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:48.985 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:48.985 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:49.043 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:49.043 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:49.043 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:49.043 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:49.293 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:49.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:49.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:49.406 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:49.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:49.481 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:49.481 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:49.538 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:49.539 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:49.539 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:49.539 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:50.044 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:50.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:50.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:50.151 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:50.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:50.234 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:50.235 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:50.292 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:50.293 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:50.293 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:50.293 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:50.540 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:50.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:50.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:50.654 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:50.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:50.734 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:50.734 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:50.791 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:50.791 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:50.791 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:50.791 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:51.294 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:51.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:51.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:51.355 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:51.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:51.439 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:51.439 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:51.495 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:51.495 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:51.495 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:51.495 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:51.791 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:51.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:51.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:51.901 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:51.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:51.976 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:51.976 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:52.034 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:52.034 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:52.035 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:52.035 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:52.496 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:52.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:52.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:52.563 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:52.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:52.647 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:52.648 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:52.705 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:52.705 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:52.705 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:52.705 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:53.036 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:53.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:53.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:53.151 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:53.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:53.232 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:53.232 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:53.289 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:53.289 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:53.289 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:53.289 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:53.707 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:53.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:53.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:53.816 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:53.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:53.897 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:53.897 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:53.954 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:53.954 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:53.954 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:53.954 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:54.290 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:54.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:54.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:54.391 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:54.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:54.474 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:54.474 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:54.530 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:54.530 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:54.530 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:54.530 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:54.956 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:54.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:54.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:55.064 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:55.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:55.149 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:55.149 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:55.207 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:55.207 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:55.208 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:55.208 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:55.531 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:55.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:55.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:55.643 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:55.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:55.718 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:55.718 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:55.775 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:55.775 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:55.775 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:55.775 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:56.209 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:56.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:56.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:56.318 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:56.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:56.400 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:56.400 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:56.458 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:56.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:56.458 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:56.458 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:56.776 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:56.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:56.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:56.887 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:56.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:56.970 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:56.970 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:57.028 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:57.028 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:57.028 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:57.028 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:57.459 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:57.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:57.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:57.569 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:57.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:57.647 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:57.647 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:57.704 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:57.705 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:57.705 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:57.705 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:58.030 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:58.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:58.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:58.144 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:58.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:58.231 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:58.231 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:58.288 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:58.289 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:58.289 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:58.289 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:58.706 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:58.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:58.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:58.813 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:51:58.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:58.896 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:58.896 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:51:58.954 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:58.954 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:58.954 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:58.954 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:59.290 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:59.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:59.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:59.401 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:51:59.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:51:59.487 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:59.487 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:51:59.545 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:59.545 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:59.545 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:59.546 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:59.956 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:59.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:51:59.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:00.064 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:00.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:00.155 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:00.155 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:00.211 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:00.211 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:00.211 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:00.211 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:00.547 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:00.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:00.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:00.658 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:00.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:00.743 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:00.743 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:00.799 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:00.800 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:00.800 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:00.800 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:01.212 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:01.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:01.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:01.322 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:01.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:01.407 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:01.407 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:01.464 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:01.465 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:01.465 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:01.465 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:01.801 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:01.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:01.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:01.913 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:01.991 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:01.991 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:01.991 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:02.049 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:02.049 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:02.049 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:02.049 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:02.466 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:02.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:02.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:02.589 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:02.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:02.662 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:02.662 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:02.719 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:02.719 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:02.719 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:02.719 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:03.051 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:03.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:03.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:03.173 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:03.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:03.247 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:03.248 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:03.304 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:03.304 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:03.304 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:03.304 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:03.719 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:03.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:03.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:03.801 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:03.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:03.889 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:03.889 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:03.945 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:03.946 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:03.946 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:03.946 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:04.306 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:04.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:04.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:04.432 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:04.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:04.517 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:04.517 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:04.573 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:04.573 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:04.573 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:04.573 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:04.947 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:04.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:04.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:05.057 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:05.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:05.132 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:05.132 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:05.189 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:05.189 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:05.189 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:05.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:05.575 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:05.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:05.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:05.686 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:05.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:05.773 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:05.773 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:05.829 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:05.829 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:05.829 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:05.829 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:06.190 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:06.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:06.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:06.316 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:06.388 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:06.388 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:06.388 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:06.444 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:06.444 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:06.444 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:06.444 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:06.830 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:06.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:06.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:06.919 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:06.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:06.994 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:06.994 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:07.050 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:07.051 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:07.051 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:07.051 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:07.445 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:07.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:07.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:07.520 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:07.593 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:07.593 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:07.593 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:07.649 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:07.650 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:07.650 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:07.650 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:08.052 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:08.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:08.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:08.122 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:08.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:08.204 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:08.204 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:08.260 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:08.261 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:08.261 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:08.261 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:08.651 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:08.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:08.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:08.736 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:08.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:08.823 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:08.823 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:08.881 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:08.881 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:08.881 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:08.882 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:09.262 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:09.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:09.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:09.372 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:09.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:09.452 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:09.452 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:09.510 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:09.511 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:09.511 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:09.511 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:09.883 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:09.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:09.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:09.989 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:10.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:10.064 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:10.064 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:10.120 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:10.121 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:10.121 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:10.121 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:10.512 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:10.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:10.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:10.623 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:10.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:10.705 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:10.705 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:10.762 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:10.763 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:10.763 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:10.763 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:11.122 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:11.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:11.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:11.193 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:11.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:11.277 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:11.277 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:11.334 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:11.335 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:11.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:11.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:11.764 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:11.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:11.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:11.875 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:11.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:11.955 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:11.955 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:12.011 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:12.012 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:12.012 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:12.012 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:12.336 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:12.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:12.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:12.445 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:12.528 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:12.528 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:12.528 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:12.585 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:12.586 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:12.586 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:12.586 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:13.013 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:13.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:13.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:13.078 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:13.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:13.153 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:13.153 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:13.211 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:13.211 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:13.211 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:13.211 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:13.587 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:13.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:13.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:13.651 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:13.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:13.730 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:13.731 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:13.787 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:13.788 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:13.788 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:13.788 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:14.212 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:14.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:14.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:14.279 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:14.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:14.365 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:14.365 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:14.423 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:14.423 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:14.423 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:14.423 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:14.790 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:14.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:14.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:14.898 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:14.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:14.980 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:14.980 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:15.038 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:15.038 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:15.038 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:15.038 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:15.425 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:15.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:15.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:15.521 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:15.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:15.602 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:15.602 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:15.659 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:15.660 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:15.660 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:15.660 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:16.040 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:16.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:16.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:16.149 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:16.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:16.225 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:16.225 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:16.283 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:16.283 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:16.283 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:16.283 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:16.661 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:16.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:16.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:16.772 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:16.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:16.846 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:16.846 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:16.903 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:16.904 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:16.904 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:16.904 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:17.285 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:17.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:17.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:17.393 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:17.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:17.469 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:17.469 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:17.526 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:17.527 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:17.527 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:17.527 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:17.905 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:17.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:17.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:18.016 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:18.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:18.091 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:18.092 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:18.149 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:18.149 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:18.149 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:18.149 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:18.528 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:18.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:18.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:18.636 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:18.715 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:18.715 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:18.715 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:18.773 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:18.773 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:18.773 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:18.773 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:19.150 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:19.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:19.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:19.261 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:19.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:19.344 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:19.344 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:19.400 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:19.401 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:19.401 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:19.401 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:19.774 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:19.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:19.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:19.882 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:19.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:19.959 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:19.959 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:20.016 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:20.017 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:20.017 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:20.017 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:20.402 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:20.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:20.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:20.512 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:20.584 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:20.584 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:20.584 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:20.640 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:20.641 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:20.641 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:20.641 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:21.018 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:21.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:21.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:21.127 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:21.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:21.200 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:21.200 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:21.257 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:21.258 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:21.258 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:21.258 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:21.642 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:21.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:21.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:21.753 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:21.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:21.833 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:21.833 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:21.889 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:21.890 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:21.890 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:21.890 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:22.259 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:22.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:22.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:22.367 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:22.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:22.449 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:22.449 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:22.507 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:22.507 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:22.508 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:22.508 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:22.891 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:22.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:22.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:23.003 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:23.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:23.076 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:23.076 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:23.134 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:23.134 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:23.134 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:23.134 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:23.509 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:23.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:23.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:23.608 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:23.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:23.683 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:23.683 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:23.740 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:23.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:23.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:23.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:24.135 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:24.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:24.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:24.247 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:24.335 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:24.335 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:24.335 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:24.391 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:24.391 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:24.391 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:24.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:24.742 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:24.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:24.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:24.852 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:24.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:24.938 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:24.938 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:24.995 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:24.995 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:24.995 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:24.996 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:25.393 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:25.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:25.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:25.504 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:25.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:25.587 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:25.587 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:25.645 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:25.645 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:25.645 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:25.646 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:25.997 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:25.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:25.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:26.104 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:26.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:26.180 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:26.180 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:26.238 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:26.239 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:26.239 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:26.239 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:26.647 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:26.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:26.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:26.759 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:26.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:26.835 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:26.835 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:26.893 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:26.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:26.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:26.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:27.240 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:27.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:27.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:27.349 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:27.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:27.423 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:27.423 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:27.480 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:27.481 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:27.481 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:27.481 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:27.895 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:27.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:27.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:28.000 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:28.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:28.079 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:28.079 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:28.137 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:28.137 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:28.137 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:28.137 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:28.483 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:28.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:28.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:28.591 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:28.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:28.668 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:28.669 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:28.727 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:28.727 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:28.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:28.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:29.138 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:29.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:29.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:29.263 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:29.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:29.344 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:29.344 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:29.401 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:29.401 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:29.401 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:29.401 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:29.729 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:29.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:29.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:29.837 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:29.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:29.925 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:29.925 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:29.982 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:29.983 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:29.983 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:29.983 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:30.402 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:30.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:30.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:30.515 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:30.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:30.600 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:30.600 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:30.657 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:30.658 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:30.658 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:30.658 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:30.984 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:30.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:30.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:31.093 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:31.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:31.177 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:31.178 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:31.235 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:31.235 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:31.235 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:31.235 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:31.659 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:31.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:31.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:31.770 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:31.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:31.851 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:31.851 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:31.907 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:31.908 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:31.908 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:31.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:32.237 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:32.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:32.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:32.373 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:32.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:32.447 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:32.447 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:32.504 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:32.504 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:32.504 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:32.504 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:32.909 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:32.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:32.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:33.020 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:33.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:33.107 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:33.107 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:33.164 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:33.165 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:33.165 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:33.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:33.505 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:33.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:33.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:33.613 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:33.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:33.690 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:33.690 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:33.747 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:33.747 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:33.747 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:33.747 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:34.166 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:34.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:34.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:34.277 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:34.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:34.355 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:34.356 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:34.412 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:34.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:34.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:34.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:34.748 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:34.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:34.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:34.859 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:34.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:34.933 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:34.933 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:34.991 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:34.991 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:34.991 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:34.991 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:35.415 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:35.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:35.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:35.526 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:35.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:35.612 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:35.612 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:35.669 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:35.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:35.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:35.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:35.992 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:35.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:35.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:36.082 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:36.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:36.159 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:36.159 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:36.215 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:36.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:36.216 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:36.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:36.671 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:36.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:36.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:36.783 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:36.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:36.869 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:36.869 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:36.927 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:36.927 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:36.927 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:36.927 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:37.217 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:37.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:37.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:37.325 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:37.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:37.410 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:37.410 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:37.466 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:37.467 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:37.467 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:37.467 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:37.928 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:37.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:37.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:38.059 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:38.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:38.144 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:38.145 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:38.201 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:38.201 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:38.202 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:38.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:38.468 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:38.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:38.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:38.576 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:38.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:38.649 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:38.650 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:38.707 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:38.707 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:38.707 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:38.707 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:39.203 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:39.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:39.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:39.312 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:39.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:39.394 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:39.394 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:39.452 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:39.452 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:39.452 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:39.452 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:39.709 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:39.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:39.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:39.816 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:39.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:39.890 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:39.890 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:39.948 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:39.948 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:39.948 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:39.948 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:40.453 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:40.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:40.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:40.517 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:40.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:40.599 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:40.599 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:40.656 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:40.657 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:40.657 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:40.657 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:40.950 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:40.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:40.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:41.058 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:41.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:41.146 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:41.146 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:41.203 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:41.203 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:41.203 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:41.203 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:41.658 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:41.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:41.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:41.772 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:41.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:41.847 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:41.847 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:41.905 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:41.905 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:41.906 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:41.906 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:42.205 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:42.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:42.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:42.313 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:42.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:42.396 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:42.396 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:42.453 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:42.454 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:42.454 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:42.454 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:42.907 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:42.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:42.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:43.044 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:43.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:43.122 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:43.122 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:43.179 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:43.180 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:43.180 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:43.180 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:43.456 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:43.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:43.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:43.564 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:43.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:43.638 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:43.638 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:43.695 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:43.696 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:43.696 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:43.696 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:44.181 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:44.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:44.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:44.268 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:44.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:44.346 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:44.346 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:44.402 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:44.403 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:44.403 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:44.403 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:44.697 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:44.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:44.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:44.805 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:44.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:44.882 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:44.882 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:44.939 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:44.939 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:44.939 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:44.939 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:45.404 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:45.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:45.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:45.513 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:45.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:45.589 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:45.589 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:45.647 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:45.648 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:45.648 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:45.648 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:45.941 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:45.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:45.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:46.049 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:46.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:46.140 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:46.140 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:46.196 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:46.197 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:46.197 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:46.197 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:46.649 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:46.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:46.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:46.760 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:46.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:46.842 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:46.842 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:46.900 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:46.900 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:46.900 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:46.900 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:47.198 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:47.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:47.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:47.306 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:47.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:47.382 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:47.382 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:47.439 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:47.440 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:47.440 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:47.440 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:47.901 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:47.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:47.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:48.013 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:48.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:48.102 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:48.102 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:48.159 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:48.160 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:48.160 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:48.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:48.442 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:48.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:48.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:48.551 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:48.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:48.633 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:48.633 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:48.690 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:48.691 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:48.691 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:48.691 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:49.162 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:49.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:49.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:49.273 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:49.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:49.359 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:49.359 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:49.416 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:49.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:49.416 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:49.416 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:49.692 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:49.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:49.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:49.800 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:49.879 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:49.879 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:49.879 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:49.937 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:49.938 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:49.938 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:49.938 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:50.417 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:50.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:50.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:50.528 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:50.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:50.616 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:50.616 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:50.673 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:50.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:50.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:50.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:50.939 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:50.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:50.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:51.047 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:51.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:51.123 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:51.124 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:51.181 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:51.182 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:51.182 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:51.182 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:51.675 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:51.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:51.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:51.786 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:51.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:51.862 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:51.862 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:51.919 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:51.920 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:51.920 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:51.920 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:52.184 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:52.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:52.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:52.292 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:52.373 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:52.373 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:52.374 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:52.430 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:52.431 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:52.431 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:52.431 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:52.921 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:52.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:52.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:52.984 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:53.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:53.073 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:53.073 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:53.131 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:53.131 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:53.131 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:53.131 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:53.432 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:53.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:53.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:53.540 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:53.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:53.615 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:53.616 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:53.672 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:53.672 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:53.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:53.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:54.133 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:54.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:54.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:54.244 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:54.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:54.323 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:54.323 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:54.380 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:54.380 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:54.380 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:54.380 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:54.674 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:54.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:54.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:54.782 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:54.861 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:54.862 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:54.862 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:54.919 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:54.919 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:54.919 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:54.919 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:55.382 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:55.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:55.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:55.495 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:55.575 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:55.575 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:55.575 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:55.632 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:55.633 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:55.633 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:55.633 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:55.920 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:55.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:55.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:56.029 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:56.111 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:56.111 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:56.111 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:56.169 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:56.169 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:56.169 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:56.169 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:56.634 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:56.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:56.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:56.746 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:56.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:56.822 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:56.822 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:56.878 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:56.879 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:56.879 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:56.879 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:57.171 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:57.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:57.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:57.280 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:57.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:57.363 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:57.363 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:57.421 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:57.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:57.422 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:57.422 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:57.880 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:57.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:57.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:57.992 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:58.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:58.063 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:58.063 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:58.120 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:58.121 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:58.121 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:58.121 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:58.423 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:58.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:58.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:58.531 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:58.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:58.610 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:58.610 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:58.667 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:58.668 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:58.668 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:58.668 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:59.122 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:59.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:59.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:59.234 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:52:59.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:52:59.309 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:59.309 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:52:59.366 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:59.367 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:59.367 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:59.367 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:59.669 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:59.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:59.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:59.777 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:52:59.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:52:59.854 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:59.854 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:52:59.910 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:59.911 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:59.911 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:59.911 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:00.368 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:00.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:00.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:00.480 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:00.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:00.565 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:00.565 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:00.623 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:00.623 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:00.623 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:00.623 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:00.912 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:00.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:00.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:01.020 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:01.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:01.104 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:01.104 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:01.160 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:01.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:01.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:01.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:01.625 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:01.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:01.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:01.735 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:01.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:01.810 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:01.810 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:01.866 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:01.867 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:01.867 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:01.867 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:02.162 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:02.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:02.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:02.270 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:02.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:02.344 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:02.344 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:02.401 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:02.401 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:02.401 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:02.402 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:02.868 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:02.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:02.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:02.979 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:03.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:03.063 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:03.063 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:03.120 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:03.121 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:03.121 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:03.121 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:03.403 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:03.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:03.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:03.476 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:03.553 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:03.553 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:03.554 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:03.610 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:03.611 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:03.611 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:03.611 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:04.123 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:04.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:04.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:04.233 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:04.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:04.311 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:04.311 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:04.369 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:04.369 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:04.369 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:04.369 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:04.612 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:04.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:04.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:04.702 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:04.783 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:04.784 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:04.784 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:04.840 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:04.840 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:04.840 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:04.840 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:05.371 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:05.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:05.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:05.481 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:05.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:05.570 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:05.570 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:05.627 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:05.627 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:05.628 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:05.628 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:05.841 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:05.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:05.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:05.950 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:06.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:06.029 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:06.029 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:06.086 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:06.086 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:06.087 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:06.087 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:06.629 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:06.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:06.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:06.740 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:06.820 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:06.820 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:06.820 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:06.877 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:06.877 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:06.877 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:06.878 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:07.088 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:07.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:07.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:07.197 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:07.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:07.280 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:07.280 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:07.337 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:07.338 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:07.338 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:07.338 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:07.879 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:07.879 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:07.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:07.990 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:08.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:08.074 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:08.074 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:08.132 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:08.132 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:08.132 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:08.133 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:08.339 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:08.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:08.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:08.445 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:08.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:08.519 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:08.519 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:08.575 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:08.576 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:08.576 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:08.576 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:09.134 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:09.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:09.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:09.203 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:09.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:09.288 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:09.288 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:09.344 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:09.344 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:09.344 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:09.344 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:09.577 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:09.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:09.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:09.686 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:09.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:09.764 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:09.764 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:09.822 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:09.822 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:09.822 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:09.822 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:10.345 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:10.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:10.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:10.410 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:10.490 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:10.490 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:10.490 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:10.548 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:10.549 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:10.549 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:10.549 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:10.823 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:10.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:10.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:10.934 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:11.008 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:11.008 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:11.008 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:11.066 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:11.066 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:11.066 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:11.066 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:11.550 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:11.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:11.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:11.663 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:11.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:11.736 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:11.737 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:11.793 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:11.794 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:11.794 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:11.794 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:12.067 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:12.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:12.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:12.177 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:12.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:12.266 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:12.266 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:12.324 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:12.324 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:12.324 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:12.324 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:12.795 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:12.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:12.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:12.905 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:12.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:12.990 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:12.990 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:13.047 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:13.048 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:13.048 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:13.048 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:13.326 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:13.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:13.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:13.433 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:13.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:13.518 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:13.518 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:13.574 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:13.574 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:13.574 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:13.574 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:14.050 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:14.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:14.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:14.143 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:14.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:14.231 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:14.231 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:14.289 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:14.289 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:14.289 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:14.289 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:14.575 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:14.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:14.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:14.664 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:14.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:14.749 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:14.749 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:14.807 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:14.807 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:14.807 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:14.807 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:15.291 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:15.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:15.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:15.367 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:15.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:15.445 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:15.445 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:15.502 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:15.502 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:15.502 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:15.502 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:15.808 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:15.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:15.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:15.917 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:15.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:15.999 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:15.999 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:16.056 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:16.057 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:16.057 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:16.057 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:16.503 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:16.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:16.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:16.579 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:16.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:16.653 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:16.653 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:16.711 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:16.712 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:16.712 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:16.712 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:17.058 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:17.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:17.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:17.166 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:17.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:17.245 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:17.245 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:17.301 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:17.301 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:17.302 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:17.302 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:17.713 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:17.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:17.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:17.825 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:17.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:17.901 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:17.901 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:17.958 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:17.958 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:17.958 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:17.958 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:18.303 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:18.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:18.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:18.412 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:18.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:18.495 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:18.495 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:18.552 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:18.553 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:18.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:18.553 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:18.959 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:18.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:18.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:19.070 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:19.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:19.159 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:19.160 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:19.217 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:19.217 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:19.217 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:19.218 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:19.555 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:19.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:19.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:19.663 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:19.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:19.746 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:19.746 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:19.802 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:19.802 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:19.803 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:19.803 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:20.219 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:20.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:20.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:20.330 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:20.414 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:20.414 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:20.414 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:20.472 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:20.473 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:20.473 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:20.473 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:20.804 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:20.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:20.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:20.912 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:21.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:21.004 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:21.004 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:21.062 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:21.063 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:21.063 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:21.063 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:21.474 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:21.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:21.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:21.586 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:21.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:21.662 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:21.662 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:21.719 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:21.719 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:21.719 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:21.719 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:22.064 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:22.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:22.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:22.172 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:22.248 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:22.248 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:22.248 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:22.305 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:22.306 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:22.306 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:22.306 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:22.721 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:22.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:22.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:22.832 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:22.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:22.920 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:22.920 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:22.977 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:22.978 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:22.978 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:22.978 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:23.307 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:23.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:23.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:23.416 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:23.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:23.503 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:23.503 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:23.560 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:23.561 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:23.561 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:23.561 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:23.979 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:23.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:23.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:24.091 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:24.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:24.176 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:24.176 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:24.232 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:24.233 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:24.233 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:24.233 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:24.562 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:24.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:24.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:24.670 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:24.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:24.761 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:24.762 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:24.819 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:24.820 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:24.820 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:24.820 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:25.234 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:25.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:25.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:25.301 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:25.375 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:25.375 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:25.375 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:25.433 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:25.433 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:25.433 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:25.433 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:25.821 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:25.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:25.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:25.930 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:26.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:26.012 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:26.013 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:26.070 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:26.071 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:26.071 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:26.071 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:26.435 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:26.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:26.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:26.546 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:26.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:26.623 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:26.624 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:26.680 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:26.681 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:26.681 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:26.681 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:27.072 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:27.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:27.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:27.180 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:27.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:27.269 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:27.269 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:27.327 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:27.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:27.327 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:27.328 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:27.682 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:27.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:27.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:27.793 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:27.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:27.878 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:27.878 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:27.936 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:27.936 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:27.936 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:27.936 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:28.329 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:28.330 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:28.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:28.437 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:28.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:28.519 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:28.519 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:28.576 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:28.576 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:28.576 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:28.576 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:28.937 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:28.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:28.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:29.048 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:29.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:29.136 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:29.136 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:29.193 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:29.194 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:29.194 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:29.194 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:29.577 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:29.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:29.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:29.686 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:29.769 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:29.769 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:29.769 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:29.825 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:29.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:29.826 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:29.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:30.195 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:30.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:30.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:30.306 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:30.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:30.385 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:30.385 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:30.442 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:30.442 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:30.442 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:30.442 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:30.827 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:30.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:30.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:30.936 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:31.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:31.010 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:31.011 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:31.067 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:31.068 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.068 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:31.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:31.443 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:31.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:31.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:31.551 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:31.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:31.623 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:31.623 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:31.680 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:31.681 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.681 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:31.681 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:32.069 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:32.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:32.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:32.178 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:32.253 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:32.253 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:32.253 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:32.310 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:32.311 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:32.311 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:32.311 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:32.682 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:32.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:32.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:32.791 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:32.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:32.865 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:32.865 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:32.924 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:32.924 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:32.924 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:32.924 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:33.313 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:33.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:33.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:33.391 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:33.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:33.461 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:33.462 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:33.518 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:33.518 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:33.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:33.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:33.925 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:33.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:33.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:33.995 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:34.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:34.071 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:34.071 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:34.128 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:34.128 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:34.128 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:34.128 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:34.519 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:34.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:34.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:34.628 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:34.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:34.716 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:34.717 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:34.773 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:34.774 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:34.774 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:34.774 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:35.129 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:35.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:35.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:35.241 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:35.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:35.321 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:35.321 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:35.379 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:35.379 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:35.379 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:35.379 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:35.776 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:35.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:35.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:35.885 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:35.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:35.970 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:35.970 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:36.027 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:36.028 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:36.028 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:36.028 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:36.380 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:36.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:36.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:36.491 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:36.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:36.582 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:36.583 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:36.641 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:36.642 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:36.642 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:36.642 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:37.030 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:37.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:37.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:37.140 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:37.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:37.218 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:37.218 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:37.275 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:37.275 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:37.275 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:37.275 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:37.643 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:37.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:37.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:37.755 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:37.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:37.842 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:37.842 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:37.901 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:37.901 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:37.901 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:37.902 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:38.276 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:38.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:38.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:38.384 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:38.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:38.460 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:38.460 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:38.517 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:38.518 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:38.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:38.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:38.903 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:38.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:38.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:39.014 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:39.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:39.089 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:39.089 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:39.146 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:39.146 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:39.146 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:39.146 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:39.519 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:39.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:39.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:39.628 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:39.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:39.704 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:39.704 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:39.761 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:39.762 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:39.762 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:39.762 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:40.147 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:40.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:40.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:40.259 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:40.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:40.334 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:40.334 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:40.391 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:40.392 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:40.392 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:40.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:40.763 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:40.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:40.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:40.873 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:40.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:40.949 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:40.949 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:41.006 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:41.006 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:41.006 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:41.006 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:41.394 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:41.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:41.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:41.507 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:41.596 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:41.597 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:41.597 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:41.654 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:41.655 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:41.655 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:41.655 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:42.007 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:42.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:42.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:42.117 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:42.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:42.193 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:42.193 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:42.250 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:42.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:42.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:42.250 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:42.656 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:42.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:42.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:42.768 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:42.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:42.841 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:42.842 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:42.899 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:42.900 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:42.900 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:42.900 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:43.251 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:43.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:43.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:43.362 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:43.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:43.451 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:43.451 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:43.508 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:43.509 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:43.509 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:43.509 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:43.901 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:43.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:43.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:44.013 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:44.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:44.085 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:44.086 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:44.143 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:44.143 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:44.144 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:44.144 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:44.510 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:44.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:44.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:44.619 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:44.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:44.705 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:44.705 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:44.762 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:44.762 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:44.762 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:44.762 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:45.145 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:45.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:45.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:45.255 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:45.335 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:45.335 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:45.336 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:45.393 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:45.393 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:45.393 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:45.393 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:45.763 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:45.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:45.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:45.871 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:45.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:45.955 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:45.956 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:46.012 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:46.012 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:46.012 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:46.012 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:46.394 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:46.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:46.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:46.506 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:46.591 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:46.591 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:46.591 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:46.648 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:46.649 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:46.649 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:46.649 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:47.013 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:47.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:47.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:47.122 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:47.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:47.197 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:47.197 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:47.253 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:47.254 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:47.254 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:47.254 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:47.650 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:47.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:47.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:47.763 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:47.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:47.838 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:47.838 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:47.894 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:47.895 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:47.895 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:47.895 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:48.255 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:48.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:48.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:48.364 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:48.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:48.440 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:48.440 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:48.497 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:48.498 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:48.498 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:48.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:48.896 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:48.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:48.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:49.007 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:49.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:49.089 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:49.090 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:49.146 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:49.146 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:49.147 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:49.147 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:49.500 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:49.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:49.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:49.608 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:49.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:49.682 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:49.682 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:49.739 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:49.740 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:49.740 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:49.740 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:50.148 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:50.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:50.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:50.263 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:50.342 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:50.342 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:50.342 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:50.398 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:50.399 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:50.399 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:50.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:50.742 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:50.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:50.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:50.851 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:50.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:50.927 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:50.927 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:50.984 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:50.984 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:50.984 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:50.984 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:51.400 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:51.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:51.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:51.511 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:51.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:51.589 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:51.589 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:51.646 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:51.647 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:51.647 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:51.647 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:51.986 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:51.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:51.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:52.095 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:52.173 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:52.173 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:52.173 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:52.230 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:52.230 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:52.230 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:52.230 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:52.648 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:52.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:52.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:52.759 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:52.848 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:52.848 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:52.848 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:52.905 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:52.906 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:52.906 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:52.906 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:53.232 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:53.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:53.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:53.346 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:53.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:53.428 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:53.428 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:53.485 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:53.485 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:53.485 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:53.485 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:53.907 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:53.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:53.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:54.017 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:54.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:54.089 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:54.090 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:54.147 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:54.147 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:54.147 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:54.148 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:54.486 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:54.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:54.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:54.594 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:54.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:54.669 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:54.670 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:54.727 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:54.727 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:54.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:54.728 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:55.149 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:55.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:55.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:55.260 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:55.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:55.334 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:55.334 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:55.391 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:55.392 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:55.392 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:55.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:55.729 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:55.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:55.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:55.837 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:55.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:55.911 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:55.911 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:55.967 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:55.968 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:55.968 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:55.968 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:56.393 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:56.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:56.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:56.504 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:56.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:56.585 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:56.585 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:56.641 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:56.642 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:56.642 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:56.642 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:56.969 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:56.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:56.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:57.077 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:57.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:57.157 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:57.157 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:57.216 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:57.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:57.216 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:57.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:57.643 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:57.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:57.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:57.755 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:57.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:57.837 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:57.837 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:57.893 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:57.894 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:57.894 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:57.894 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:58.218 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:58.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:58.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:58.327 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:58.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:58.403 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:58.403 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:58.460 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:58.460 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:58.460 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:58.460 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:58.896 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:58.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:58.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:59.007 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:53:59.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:53:59.081 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:59.082 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:53:59.138 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:59.139 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:59.139 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:59.139 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:59.462 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:59.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:59.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:59.571 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:53:59.655 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:53:59.655 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:59.655 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:53:59.712 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:59.713 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:59.713 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:59.713 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:00.141 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:00.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:00.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:00.252 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:00.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:00.334 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:00.334 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:00.391 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:00.392 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:00.392 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:00.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:00.714 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:00.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:00.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:00.823 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:00.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:00.905 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:00.906 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:00.963 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:00.963 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:00.963 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:00.963 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:01.394 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:01.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:01.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:01.504 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:01.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:01.579 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:01.579 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:01.635 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:01.636 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:01.636 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:01.636 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:01.965 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:01.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:01.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:02.074 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:02.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:02.146 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:02.146 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:02.204 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:02.204 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:02.204 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:02.204 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:02.637 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:02.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:02.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:02.749 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:02.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:02.829 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:02.829 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:02.886 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:02.886 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:02.886 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:02.887 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:03.206 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:03.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:03.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:03.314 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:03.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:03.390 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:03.390 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:03.449 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:03.449 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:03.449 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:03.449 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:03.888 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:03.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:03.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:03.999 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:04.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:04.081 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:04.082 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:04.138 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:04.139 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:04.139 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:04.139 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:04.451 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:04.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:04.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:04.559 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:04.644 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:04.645 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:04.645 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:04.702 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:04.702 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:04.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:04.703 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:05.140 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:05.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:05.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:05.250 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:05.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:05.325 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:05.325 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:05.381 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:05.382 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:05.382 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:05.382 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:05.704 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:05.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:05.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:05.813 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:05.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:05.891 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:05.891 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:05.948 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:05.949 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:05.949 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:05.949 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:06.383 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:06.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:06.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:06.448 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:06.524 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:06.524 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:06.524 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:06.580 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:06.580 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:06.580 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:06.581 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:06.950 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:06.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:06.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:07.058 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:07.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:07.138 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:07.138 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:07.196 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:07.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:07.196 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:07.197 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:07.582 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:07.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:07.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:07.693 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:07.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:07.774 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:07.774 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:07.830 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:07.831 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:07.831 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:07.831 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:08.198 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:08.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:08.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:08.307 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:08.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:08.383 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:08.383 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:08.441 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:08.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:08.441 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:08.441 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:08.832 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:08.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:08.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:08.943 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:09.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:09.030 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:09.030 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:09.087 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:09.087 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:09.088 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:09.088 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:09.443 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:09.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:09.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:09.551 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:09.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:09.640 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:09.640 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:09.698 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:09.698 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:09.698 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:09.698 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:10.089 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:10.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:10.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:10.201 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:10.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:10.280 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:10.280 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:10.337 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:10.337 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:10.337 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:10.337 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:10.699 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:10.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:10.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:10.808 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:10.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:10.889 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:10.889 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:10.945 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:10.946 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:10.946 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:10.946 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:11.338 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:11.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:11.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:11.450 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:11.528 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:11.529 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:11.529 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:11.586 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:11.587 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:11.587 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:11.587 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:11.947 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:11.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:11.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:12.055 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:12.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:12.134 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:12.134 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:12.193 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:12.193 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:12.193 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:12.194 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:12.589 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:12.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:12.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:12.699 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:12.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:12.776 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:12.776 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:12.833 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:12.834 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:12.834 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:12.834 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:13.195 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:13.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:13.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:13.303 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:13.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:13.387 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:13.387 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:13.446 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:13.446 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:13.446 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:13.446 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:13.836 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:13.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:13.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:13.946 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:14.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:14.020 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:14.020 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:14.077 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:14.078 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:14.078 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:14.078 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:14.448 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:14.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:14.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:14.558 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:14.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:14.641 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:14.641 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:14.697 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:14.698 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:14.698 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:14.698 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:15.079 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:15.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:15.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:15.191 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:15.264 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:15.265 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:15.265 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:15.321 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:15.321 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:15.321 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:15.321 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:15.699 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:15.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:15.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:15.808 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:15.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:15.887 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:15.887 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:15.943 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:15.944 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:15.944 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:15.944 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:16.322 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:16.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:16.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:16.451 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:16.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:16.534 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:16.535 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:16.593 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:16.593 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:16.594 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:16.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:16.945 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:16.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:16.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:17.053 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:17.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:17.130 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:17.130 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:17.186 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:17.187 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:17.187 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:17.187 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:17.594 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:17.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:17.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:17.662 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:17.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:17.738 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:17.738 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:17.795 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:17.795 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:17.795 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:17.795 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:18.188 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:18.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:18.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:18.293 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:18.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:18.366 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:18.366 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:18.424 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:18.424 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.425 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:18.425 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:18.796 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:18.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:18.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:18.908 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:18.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:18.997 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:18.997 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:19.056 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:19.056 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.056 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:19.057 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:19.426 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:19.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:19.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:19.534 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:19.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:19.619 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:19.619 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:19.676 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:19.677 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.677 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:19.677 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:20.058 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:20.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:20.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:20.168 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:20.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:20.241 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:20.241 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:20.298 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:20.299 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:20.299 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:20.299 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:20.678 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:20.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:20.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:20.787 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:20.866 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:20.866 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:20.866 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:20.923 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:20.923 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:20.923 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:20.923 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:21.300 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:21.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:21.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:21.410 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:21.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:21.485 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:21.485 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:21.541 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:21.542 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:21.542 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:21.542 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:21.925 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:21.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:21.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:22.033 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:22.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:22.108 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:22.108 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:22.164 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:22.164 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:22.164 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:22.164 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:22.543 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:22.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:22.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:22.649 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:22.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:22.735 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:22.735 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:22.793 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:22.793 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:22.793 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:22.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:23.166 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:23.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:23.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:23.274 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:23.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:23.348 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:23.348 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:23.405 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:23.405 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:23.405 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:23.406 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:23.795 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:23.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:23.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:23.906 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:23.991 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:23.992 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:23.992 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:24.049 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:24.050 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:24.050 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:24.050 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:24.406 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:24.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:24.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:24.514 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:24.593 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:24.594 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:24.594 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:24.652 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:24.652 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:24.652 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:24.652 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:25.052 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:25.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:25.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:25.164 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:25.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:25.245 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:25.245 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:25.301 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:25.302 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:25.302 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:25.302 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:25.653 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:25.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:25.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:25.761 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:25.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:25.840 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:25.840 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:25.899 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:25.899 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:25.899 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:25.899 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:26.304 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:26.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:26.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:26.415 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:26.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:26.501 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:26.501 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:26.557 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:26.558 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:26.558 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:26.558 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:26.900 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:26.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:26.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:27.009 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:27.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:27.098 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:27.098 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:27.155 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:27.155 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:27.155 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:27.156 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:27.559 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:27.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:27.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:27.671 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:27.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:27.746 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:27.746 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:27.803 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:27.804 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:27.804 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:27.804 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:28.157 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:28.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:28.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:28.265 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:28.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:28.347 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:28.347 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:28.405 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:28.405 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:28.406 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:28.406 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:28.805 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:28.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:28.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:28.931 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:29.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:29.015 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:29.015 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:29.073 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:29.073 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:29.073 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:29.073 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:29.407 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:29.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:29.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:29.515 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:29.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:29.604 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:29.604 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:29.660 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:29.660 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:29.660 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:29.660 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:30.074 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:30.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:30.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:30.216 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:30.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:30.286 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:30.286 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:30.343 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:30.343 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:30.343 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:30.343 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:30.661 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:30.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:30.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:30.783 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:30.866 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:30.866 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:30.866 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:30.923 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:30.924 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:30.924 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:30.924 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:31.344 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:31.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:31.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:31.455 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:31.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:31.534 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:31.534 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:31.592 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:31.592 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:31.592 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:31.592 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:31.925 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:31.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:31.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:32.033 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:32.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:32.110 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:32.110 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:32.168 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:32.168 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:32.168 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:32.168 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:32.593 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:32.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:32.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:32.704 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:32.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:32.793 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:32.794 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:32.851 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:32.851 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:32.851 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:32.851 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:33.169 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:33.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:33.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:33.277 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:33.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:33.359 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:33.359 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:33.415 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:33.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:33.416 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:33.416 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:33.853 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:33.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:33.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:33.964 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:34.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:34.036 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:34.036 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:34.093 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:34.094 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:34.094 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:34.094 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:34.417 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:34.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:34.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:34.525 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:34.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:34.601 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:34.601 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:34.659 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:34.659 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:34.659 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:34.659 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:35.095 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:35.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:35.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:35.206 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:35.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:35.285 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:35.285 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:35.342 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:35.343 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:35.343 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:35.343 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:35.661 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:35.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:35.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:35.770 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:35.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:35.852 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:35.852 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:35.909 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:35.909 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:35.909 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:35.909 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:36.344 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:36.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:36.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:36.457 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:36.533 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:36.533 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:36.533 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:36.590 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:36.590 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:36.590 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:36.591 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:36.911 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:36.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:36.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:37.020 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:37.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:37.103 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:37.104 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:37.160 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:37.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:37.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:37.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:37.592 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:37.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:37.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:37.705 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:37.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:37.792 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:37.792 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:37.849 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:37.849 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:37.849 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:37.849 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:38.162 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:38.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:38.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:38.270 DEBUG:teuthology.orchestra.run.trial089:> true 2026-02-12T22:54:38.342 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com' 2026-02-12T22:54:38.342 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:38.342 DEBUG:teuthology.orchestra.run.trial089:> uname -r 2026-02-12T22:54:38.400 INFO:teuthology.orchestra.run.trial089.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:38.401 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:38.401 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:38.401 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:38.851 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:38.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:38.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:38.963 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-12T22:54:39.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-12T22:54:39.039 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:39.039 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-12T22:54:39.096 INFO:teuthology.orchestra.run.trial163.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:39.096 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:39.096 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:39.096 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:39.097 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:39.100 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:54:39.113 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:54:39.145 INFO:teuthology.run:Summary data: description: fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/workunit/dir-max-entries} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:54:39.146 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:54:39.269 INFO:teuthology.run:FAIL