2026-02-12T22:08:52.702 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:08:52.718 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:08:52.812 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47133 branch: wip-pdonnell-testing-20260210.171210 description: fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_pjd} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47133' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client acl type: posix_acl fuse set user groups: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxSQMHDcJfPOg1fIPWSAhfjvXoC63+5VW/3rVWGhr0cONzCYT/32IEToP5WXlfn933Wu8me2P9Fb11S1nQ//fw= trial178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIX62n7RAW+bwXMBAuXY1K8zY+QWOeysv4vGict3gBZz/smmZ8fw67ahaOq5jccOmHNCvIe468Jii1/Id3PCj7s= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - ceph-fuse: null - workunit: clients: all: - suites/pjd.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:08:52.812 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:08:52.813 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:08:52.813 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:08:52.814 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:08:52.814 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:08:52.814 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:08:52.815 INFO:teuthology.packaging:ref: None 2026-02-12T22:08:52.815 INFO:teuthology.packaging:tag: None 2026-02-12T22:08:52.815 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:08:52.815 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:08:52.815 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:08:52.938 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:08:52.939 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:08:52.950 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:08:52.950 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:08:52.964 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:08:52.981 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:08:52.993 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:08:53.068 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial070.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47133', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:05:29.619761', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxSQMHDcJfPOg1fIPWSAhfjvXoC63+5VW/3rVWGhr0cONzCYT/32IEToP5WXlfn933Wu8me2P9Fb11S1nQ//fw='} 2026-02-12T22:08:53.124 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial178.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47133', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:05:29.619072', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIX62n7RAW+bwXMBAuXY1K8zY+QWOeysv4vGict3gBZz/smmZ8fw67ahaOq5jccOmHNCvIe468Jii1/Id3PCj7s='} 2026-02-12T22:08:53.124 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:08:53.136 INFO:teuthology.task.internal:roles: ubuntu@trial070.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-12T22:08:53.136 INFO:teuthology.task.internal:roles: ubuntu@trial178.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2026-02-12T22:08:53.136 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:08:53.274 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7e4891dd6d40>, signals=[15]) 2026-02-12T22:08:53.274 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:08:53.288 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:08:53.288 DEBUG:teuthology.task.internal:connecting to ubuntu@trial070.front.sepia.ceph.com 2026-02-12T22:08:53.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:53.350 DEBUG:teuthology.task.internal:connecting to ubuntu@trial178.front.sepia.ceph.com 2026-02-12T22:08:53.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:53.412 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:08:53.424 DEBUG:teuthology.orchestra.run.trial070:> uname -m 2026-02-12T22:08:53.441 INFO:teuthology.orchestra.run.trial070.stdout:x86_64 2026-02-12T22:08:53.441 DEBUG:teuthology.orchestra.run.trial070:> cat /etc/os-release 2026-02-12T22:08:53.499 INFO:teuthology.orchestra.run.trial070.stdout:NAME="Rocky Linux" 2026-02-12T22:08:53.499 INFO:teuthology.orchestra.run.trial070.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:08:53.499 INFO:teuthology.orchestra.run.trial070.stdout:ID="rocky" 2026-02-12T22:08:53.499 INFO:teuthology.orchestra.run.trial070.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:08:53.499 INFO:teuthology.orchestra.run.trial070.stdout:VERSION_ID="10.1" 2026-02-12T22:08:53.499 INFO:teuthology.orchestra.run.trial070.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:08:53.499 INFO:teuthology.orchestra.run.trial070.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:08:53.499 INFO:teuthology.orchestra.run.trial070.stdout:ANSI_COLOR="0;32" 2026-02-12T22:08:53.499 INFO:teuthology.orchestra.run.trial070.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:08:53.499 INFO:teuthology.orchestra.run.trial070.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:08:53.499 INFO:teuthology.orchestra.run.trial070.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:08:53.500 INFO:teuthology.orchestra.run.trial070.stdout:VENDOR_NAME="RESF" 2026-02-12T22:08:53.500 INFO:teuthology.orchestra.run.trial070.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:08:53.500 INFO:teuthology.orchestra.run.trial070.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:08:53.500 INFO:teuthology.orchestra.run.trial070.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:08:53.500 INFO:teuthology.orchestra.run.trial070.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:08:53.500 INFO:teuthology.orchestra.run.trial070.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:08:53.500 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:08:53.500 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:08:53.500 INFO:teuthology.lock.ops:Updating trial070.front.sepia.ceph.com on lock server 2026-02-12T22:08:53.579 DEBUG:teuthology.orchestra.run.trial178:> uname -m 2026-02-12T22:08:53.596 INFO:teuthology.orchestra.run.trial178.stdout:x86_64 2026-02-12T22:08:53.596 DEBUG:teuthology.orchestra.run.trial178:> cat /etc/os-release 2026-02-12T22:08:53.653 INFO:teuthology.orchestra.run.trial178.stdout:NAME="Rocky Linux" 2026-02-12T22:08:53.654 INFO:teuthology.orchestra.run.trial178.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:08:53.654 INFO:teuthology.orchestra.run.trial178.stdout:ID="rocky" 2026-02-12T22:08:53.654 INFO:teuthology.orchestra.run.trial178.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:08:53.654 INFO:teuthology.orchestra.run.trial178.stdout:VERSION_ID="10.1" 2026-02-12T22:08:53.654 INFO:teuthology.orchestra.run.trial178.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:08:53.654 INFO:teuthology.orchestra.run.trial178.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:08:53.654 INFO:teuthology.orchestra.run.trial178.stdout:ANSI_COLOR="0;32" 2026-02-12T22:08:53.654 INFO:teuthology.orchestra.run.trial178.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:08:53.654 INFO:teuthology.orchestra.run.trial178.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:08:53.654 INFO:teuthology.orchestra.run.trial178.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:08:53.654 INFO:teuthology.orchestra.run.trial178.stdout:VENDOR_NAME="RESF" 2026-02-12T22:08:53.654 INFO:teuthology.orchestra.run.trial178.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:08:53.654 INFO:teuthology.orchestra.run.trial178.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:08:53.654 INFO:teuthology.orchestra.run.trial178.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:08:53.654 INFO:teuthology.orchestra.run.trial178.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:08:53.655 INFO:teuthology.orchestra.run.trial178.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:08:53.655 INFO:teuthology.orchestra.run.trial178.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:08:53.655 INFO:teuthology.orchestra.run.trial178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:08:53.655 INFO:teuthology.lock.ops:Updating trial178.front.sepia.ceph.com on lock server 2026-02-12T22:08:53.739 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:08:53.752 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:08:53.762 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:08:53.762 DEBUG:teuthology.orchestra.run.trial070:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:08:53.764 DEBUG:teuthology.orchestra.run.trial178:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:08:53.780 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:08:53.791 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:08:53.791 DEBUG:teuthology.orchestra.run.trial070:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:08:53.820 DEBUG:teuthology.orchestra.run.trial178:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:08:53.837 INFO:teuthology.orchestra.run.trial070.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:08:53.838 INFO:teuthology.orchestra.run.trial178.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:08:53.838 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:08:54.004 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:08:54.024 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:08:54.024 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:08:54.024 DEBUG:teuthology.orchestra.run.trial070:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:08:54.024 DEBUG:teuthology.orchestra.run.trial178:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:08:54.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:08:54.040 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:08:54.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:08:54.041 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:08:54.097 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:54.097 INFO:teuthology.task.kernel:Running kernel on trial070: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:54.097 DEBUG:teuthology.orchestra.run.trial070:> sudo yum install -y kernel 2026-02-12T22:08:54.098 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:54.098 INFO:teuthology.task.kernel:Running kernel on trial178: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:54.098 DEBUG:teuthology.orchestra.run.trial178:> sudo yum install -y kernel 2026-02-12T22:08:54.729 INFO:teuthology.orchestra.run.trial070.stdout:Rocky Linux 10 - AppStream 9.6 MB/s | 2.2 MB 00:00 2026-02-12T22:08:54.880 INFO:teuthology.orchestra.run.trial178.stdout:Rocky Linux 10 - AppStream 5.7 MB/s | 2.2 MB 00:00 2026-02-12T22:08:56.109 INFO:teuthology.orchestra.run.trial070.stdout:Rocky Linux 10 - BaseOS 8.8 MB/s | 11 MB 00:01 2026-02-12T22:08:56.329 INFO:teuthology.orchestra.run.trial178.stdout:Rocky Linux 10 - BaseOS 8.3 MB/s | 11 MB 00:01 2026-02-12T22:08:56.608 INFO:teuthology.orchestra.run.trial070.stdout:Rocky Linux 10 - CRB 5.9 MB/s | 503 kB 00:00 2026-02-12T22:08:57.320 INFO:teuthology.orchestra.run.trial178.stdout:Rocky Linux 10 - CRB 876 kB/s | 507 kB 00:00 2026-02-12T22:08:58.094 INFO:teuthology.orchestra.run.trial070.stdout:Extra Packages for Enterprise Linux 4.3 MB/s | 6.2 MB 00:01 2026-02-12T22:08:58.317 INFO:teuthology.orchestra.run.trial178.stdout:Extra Packages for Enterprise Linux 6.5 MB/s | 6.2 MB 00:00 2026-02-12T22:08:58.747 INFO:teuthology.orchestra.run.trial070.stdout:lab-extras 291 kB/s | 3.7 kB 00:00 2026-02-12T22:08:58.968 INFO:teuthology.orchestra.run.trial178.stdout:lab-extras 287 kB/s | 3.7 kB 00:00 2026-02-12T22:08:59.162 INFO:teuthology.orchestra.run.trial070.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:08:59.173 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-12T22:08:59.174 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-12T22:08:59.174 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-12T22:08:59.175 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-12T22:08:59.175 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-12T22:08:59.175 INFO:teuthology.orchestra.run.trial070.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:08:59.175 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-12T22:08:59.175 INFO:teuthology.orchestra.run.trial070.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:08:59.175 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:08:59.175 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:08:59.175 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:08:59.175 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-12T22:08:59.175 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-12T22:08:59.176 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-12T22:08:59.176 INFO:teuthology.orchestra.run.trial070.stdout:Install 5 Packages 2026-02-12T22:08:59.176 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-12T22:08:59.176 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 93 M 2026-02-12T22:08:59.176 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 135 M 2026-02-12T22:08:59.177 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-12T22:08:59.229 INFO:teuthology.orchestra.run.trial070.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 26 MB/s | 1.4 MB 00:00 2026-02-12T22:08:59.377 INFO:teuthology.orchestra.run.trial178.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:08:59.389 INFO:teuthology.orchestra.run.trial178.stdout:Dependencies resolved. 2026-02-12T22:08:59.390 INFO:teuthology.orchestra.run.trial178.stdout:================================================================================ 2026-02-12T22:08:59.390 INFO:teuthology.orchestra.run.trial178.stdout: Package Arch Version Repo Size 2026-02-12T22:08:59.390 INFO:teuthology.orchestra.run.trial178.stdout:================================================================================ 2026-02-12T22:08:59.390 INFO:teuthology.orchestra.run.trial178.stdout:Installing: 2026-02-12T22:08:59.390 INFO:teuthology.orchestra.run.trial178.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:08:59.391 INFO:teuthology.orchestra.run.trial178.stdout:Installing dependencies: 2026-02-12T22:08:59.391 INFO:teuthology.orchestra.run.trial178.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:08:59.391 INFO:teuthology.orchestra.run.trial178.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:08:59.391 INFO:teuthology.orchestra.run.trial178.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:08:59.391 INFO:teuthology.orchestra.run.trial178.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:08:59.391 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-12T22:08:59.391 INFO:teuthology.orchestra.run.trial178.stdout:Transaction Summary 2026-02-12T22:08:59.391 INFO:teuthology.orchestra.run.trial178.stdout:================================================================================ 2026-02-12T22:08:59.391 INFO:teuthology.orchestra.run.trial178.stdout:Install 5 Packages 2026-02-12T22:08:59.391 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-12T22:08:59.391 INFO:teuthology.orchestra.run.trial178.stdout:Total download size: 93 M 2026-02-12T22:08:59.392 INFO:teuthology.orchestra.run.trial178.stdout:Installed size: 135 M 2026-02-12T22:08:59.392 INFO:teuthology.orchestra.run.trial178.stdout:Downloading Packages: 2026-02-12T22:08:59.464 INFO:teuthology.orchestra.run.trial070.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 64 MB/s | 18 MB 00:00 2026-02-12T22:08:59.527 INFO:teuthology.orchestra.run.trial070.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 45 MB/s | 2.8 MB 00:00 2026-02-12T22:08:59.646 INFO:teuthology.orchestra.run.trial178.stdout:(1/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 72 MB/s | 18 MB 00:00 2026-02-12T22:08:59.649 INFO:teuthology.orchestra.run.trial178.stdout:(2/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 5.4 MB/s | 1.4 MB 00:00 2026-02-12T22:08:59.705 INFO:teuthology.orchestra.run.trial070.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 62 MB/s | 30 MB 00:00 2026-02-12T22:08:59.933 INFO:teuthology.orchestra.run.trial178.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 9.9 MB/s | 2.8 MB 00:00 2026-02-12T22:09:00.003 INFO:teuthology.orchestra.run.trial178.stdout:(4/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 66 MB/s | 41 MB 00:00 2026-02-12T22:09:00.079 INFO:teuthology.orchestra.run.trial178.stdout:(5/5): kernel-modules-core-6.12.0-124.31.1.el10 68 MB/s | 30 MB 00:00 2026-02-12T22:09:00.080 INFO:teuthology.orchestra.run.trial178.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:09:00.080 INFO:teuthology.orchestra.run.trial178.stdout:Total 134 MB/s | 93 MB 00:00 2026-02-12T22:09:00.080 INFO:teuthology.orchestra.run.trial178.stdout:Running transaction check 2026-02-12T22:09:00.225 INFO:teuthology.orchestra.run.trial178.stdout:Transaction check succeeded. 2026-02-12T22:09:00.226 INFO:teuthology.orchestra.run.trial178.stdout:Running transaction test 2026-02-12T22:09:00.627 INFO:teuthology.orchestra.run.trial178.stdout:Transaction test succeeded. 2026-02-12T22:09:00.627 INFO:teuthology.orchestra.run.trial178.stdout:Running transaction 2026-02-12T22:09:01.321 INFO:teuthology.orchestra.run.trial178.stdout: Preparing : 1/1 2026-02-12T22:09:01.522 INFO:teuthology.orchestra.run.trial178.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:09:01.544 INFO:teuthology.orchestra.run.trial178.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:09:02.798 INFO:teuthology.orchestra.run.trial178.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:09:02.826 INFO:teuthology.orchestra.run.trial178.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:09:03.050 INFO:teuthology.orchestra.run.trial070.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 10 MB/s | 41 MB 00:03 2026-02-12T22:09:03.051 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:09:03.051 INFO:teuthology.orchestra.run.trial070.stdout:Total 24 MB/s | 93 MB 00:03 2026-02-12T22:09:03.051 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-12T22:09:03.199 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-12T22:09:03.199 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-12T22:09:03.602 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-12T22:09:03.602 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-12T22:09:04.297 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-12T22:09:04.499 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:09:04.520 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:09:04.674 INFO:teuthology.orchestra.run.trial178.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:09:04.680 INFO:teuthology.orchestra.run.trial178.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:09:05.778 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:09:05.806 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:09:06.543 INFO:teuthology.orchestra.run.trial178.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:09:06.554 INFO:teuthology.orchestra.run.trial178.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:07.651 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:09:07.657 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:09:08.414 INFO:teuthology.orchestra.run.trial178.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:09.517 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:09:09.527 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:11.391 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:42.053 INFO:teuthology.orchestra.run.trial178.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:42.075 INFO:teuthology.orchestra.run.trial178.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:42.306 INFO:teuthology.orchestra.run.trial178.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:42.306 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-12T22:09:42.306 INFO:teuthology.orchestra.run.trial178.stdout:Installed: 2026-02-12T22:09:42.306 INFO:teuthology.orchestra.run.trial178.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:42.306 INFO:teuthology.orchestra.run.trial178.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:42.306 INFO:teuthology.orchestra.run.trial178.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:42.306 INFO:teuthology.orchestra.run.trial178.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:42.306 INFO:teuthology.orchestra.run.trial178.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:42.307 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-12T22:09:42.307 INFO:teuthology.orchestra.run.trial178.stdout:Complete! 2026-02-12T22:09:42.368 DEBUG:teuthology.orchestra.run.trial178:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:09:42.443 INFO:teuthology.orchestra.run.trial178.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:42.444 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:42.444 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:42.444 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:09:42.444 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:09:42.444 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:09:42.444 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial178.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:09:42.445 DEBUG:teuthology.orchestra.run.trial178:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:09:42.518 INFO:teuthology.orchestra.run.trial178.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:42.519 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:42.519 DEBUG:teuthology.orchestra.run.trial178:> sudo rpm -qi grub2-tools 2026-02-12T22:09:42.591 INFO:teuthology.orchestra.run.trial178.stdout:Name : grub2-tools 2026-02-12T22:09:42.591 INFO:teuthology.orchestra.run.trial178.stdout:Epoch : 1 2026-02-12T22:09:42.591 INFO:teuthology.orchestra.run.trial178.stdout:Version : 2.12 2026-02-12T22:09:42.591 INFO:teuthology.orchestra.run.trial178.stdout:Release : 29.el10_1 2026-02-12T22:09:42.591 INFO:teuthology.orchestra.run.trial178.stdout:Architecture: x86_64 2026-02-12T22:09:42.591 INFO:teuthology.orchestra.run.trial178.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:09:42.591 INFO:teuthology.orchestra.run.trial178.stdout:Group : Unspecified 2026-02-12T22:09:42.591 INFO:teuthology.orchestra.run.trial178.stdout:Size : 7963769 2026-02-12T22:09:42.591 INFO:teuthology.orchestra.run.trial178.stdout:License : GPL-3.0-or-later 2026-02-12T22:09:42.591 INFO:teuthology.orchestra.run.trial178.stdout:Signature : 2026-02-12T22:09:42.592 INFO:teuthology.orchestra.run.trial178.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:09:42.592 INFO:teuthology.orchestra.run.trial178.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:09:42.592 INFO:teuthology.orchestra.run.trial178.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:09:42.592 INFO:teuthology.orchestra.run.trial178.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:09:42.592 INFO:teuthology.orchestra.run.trial178.stdout:Packager : Release Engineering 2026-02-12T22:09:42.592 INFO:teuthology.orchestra.run.trial178.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:09:42.592 INFO:teuthology.orchestra.run.trial178.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:09:42.592 INFO:teuthology.orchestra.run.trial178.stdout:Summary : Support tools for GRUB. 2026-02-12T22:09:42.592 INFO:teuthology.orchestra.run.trial178.stdout:Description : 2026-02-12T22:09:42.592 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-12T22:09:42.592 INFO:teuthology.orchestra.run.trial178.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:09:42.593 INFO:teuthology.orchestra.run.trial178.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:09:42.593 INFO:teuthology.orchestra.run.trial178.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:09:42.593 INFO:teuthology.orchestra.run.trial178.stdout:hardware devices. 2026-02-12T22:09:42.593 INFO:teuthology.orchestra.run.trial178.stdout: 2026-02-12T22:09:42.593 INFO:teuthology.orchestra.run.trial178.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:09:42.594 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:09:42.594 INFO:teuthology.task.kernel:Updating grub on trial178 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:42.594 DEBUG:teuthology.orchestra.run.trial178:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:09:42.660 INFO:teuthology.orchestra.run.trial178.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:09:42.661 DEBUG:teuthology.orchestra.run.trial178:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:09:42.727 INFO:teuthology.orchestra.run.trial178.stdout:/sbin/grubby 2026-02-12T22:09:42.728 INFO:teuthology.orchestra.run.trial178.stdout:yes 2026-02-12T22:09:42.728 DEBUG:teuthology.orchestra.run.trial178:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:09:42.793 INFO:teuthology.orchestra.run.trial178.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:09:42.795 DEBUG:teuthology.orchestra.run.trial178:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:42.870 DEBUG:teuthology.orchestra.run.trial178:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:09:42.984 INFO:teuthology.orchestra.run.trial178.stderr:Generating grub configuration file ... 2026-02-12T22:09:43.163 INFO:teuthology.orchestra.run.trial178.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:09:43.172 INFO:teuthology.orchestra.run.trial178.stderr:done 2026-02-12T22:09:43.174 DEBUG:teuthology.orchestra.run.trial178:> test -d /sys/firmware/efi 2026-02-12T22:09:43.191 DEBUG:teuthology.orchestra.run.trial178:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:09:43.262 INFO:teuthology.orchestra.run.trial178.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:09:43.263 INFO:teuthology.orchestra.run.trial178.stdout:/boot/efi/EFI/rocky 2026-02-12T22:09:43.264 DEBUG:teuthology.orchestra.run.trial178:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:09:43.332 INFO:teuthology.orchestra.run.trial178.stdout:no 2026-02-12T22:09:43.332 DEBUG:teuthology.orchestra.run.trial178:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:09:43.398 INFO:teuthology.orchestra.run.trial178.stdout:yes 2026-02-12T22:09:43.398 DEBUG:teuthology.orchestra.run.trial178:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:09:43.466 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial178 2026-02-12T22:09:43.466 DEBUG:teuthology.orchestra.run.trial178:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:09:43.530 INFO:teuthology.orchestra.run.trial178.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:09:45.171 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:45.195 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:45.428 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:09:45.428 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-12T22:09:45.428 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-12T22:09:45.428 INFO:teuthology.orchestra.run.trial070.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:45.428 INFO:teuthology.orchestra.run.trial070.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:45.429 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:45.429 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:45.429 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:45.429 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-12T22:09:45.429 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-12T22:09:45.490 DEBUG:teuthology.orchestra.run.trial070:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:09:45.525 INFO:teuthology.orchestra.run.trial070.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:45.526 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:45.527 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:45.527 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:09:45.527 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:09:45.527 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:09:45.527 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial070.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:09:45.527 DEBUG:teuthology.orchestra.run.trial070:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:09:45.600 INFO:teuthology.orchestra.run.trial070.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:45.601 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:45.601 DEBUG:teuthology.orchestra.run.trial070:> sudo rpm -qi grub2-tools 2026-02-12T22:09:45.672 INFO:teuthology.orchestra.run.trial070.stdout:Name : grub2-tools 2026-02-12T22:09:45.673 INFO:teuthology.orchestra.run.trial070.stdout:Epoch : 1 2026-02-12T22:09:45.673 INFO:teuthology.orchestra.run.trial070.stdout:Version : 2.12 2026-02-12T22:09:45.673 INFO:teuthology.orchestra.run.trial070.stdout:Release : 29.el10_1 2026-02-12T22:09:45.673 INFO:teuthology.orchestra.run.trial070.stdout:Architecture: x86_64 2026-02-12T22:09:45.673 INFO:teuthology.orchestra.run.trial070.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:09:45.673 INFO:teuthology.orchestra.run.trial070.stdout:Group : Unspecified 2026-02-12T22:09:45.673 INFO:teuthology.orchestra.run.trial070.stdout:Size : 7963769 2026-02-12T22:09:45.673 INFO:teuthology.orchestra.run.trial070.stdout:License : GPL-3.0-or-later 2026-02-12T22:09:45.673 INFO:teuthology.orchestra.run.trial070.stdout:Signature : 2026-02-12T22:09:45.673 INFO:teuthology.orchestra.run.trial070.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:09:45.673 INFO:teuthology.orchestra.run.trial070.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:09:45.674 INFO:teuthology.orchestra.run.trial070.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:09:45.674 INFO:teuthology.orchestra.run.trial070.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:09:45.674 INFO:teuthology.orchestra.run.trial070.stdout:Packager : Release Engineering 2026-02-12T22:09:45.674 INFO:teuthology.orchestra.run.trial070.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:09:45.674 INFO:teuthology.orchestra.run.trial070.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:09:45.674 INFO:teuthology.orchestra.run.trial070.stdout:Summary : Support tools for GRUB. 2026-02-12T22:09:45.674 INFO:teuthology.orchestra.run.trial070.stdout:Description : 2026-02-12T22:09:45.674 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-12T22:09:45.674 INFO:teuthology.orchestra.run.trial070.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:09:45.674 INFO:teuthology.orchestra.run.trial070.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:09:45.674 INFO:teuthology.orchestra.run.trial070.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:09:45.674 INFO:teuthology.orchestra.run.trial070.stdout:hardware devices. 2026-02-12T22:09:45.675 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-12T22:09:45.675 INFO:teuthology.orchestra.run.trial070.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:09:45.676 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:09:45.676 INFO:teuthology.task.kernel:Updating grub on trial070 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:45.676 DEBUG:teuthology.orchestra.run.trial070:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:09:45.742 INFO:teuthology.orchestra.run.trial070.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:09:45.743 DEBUG:teuthology.orchestra.run.trial070:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:09:45.808 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/grubby 2026-02-12T22:09:45.809 INFO:teuthology.orchestra.run.trial070.stdout:yes 2026-02-12T22:09:45.810 DEBUG:teuthology.orchestra.run.trial070:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:09:45.877 INFO:teuthology.orchestra.run.trial070.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:09:45.878 DEBUG:teuthology.orchestra.run.trial070:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:09:45.955 DEBUG:teuthology.orchestra.run.trial070:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:09:46.067 INFO:teuthology.orchestra.run.trial070.stderr:Generating grub configuration file ... 2026-02-12T22:09:46.250 INFO:teuthology.orchestra.run.trial070.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:09:46.259 INFO:teuthology.orchestra.run.trial070.stderr:done 2026-02-12T22:09:46.261 DEBUG:teuthology.orchestra.run.trial070:> test -d /sys/firmware/efi 2026-02-12T22:09:46.278 DEBUG:teuthology.orchestra.run.trial070:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:09:46.349 INFO:teuthology.orchestra.run.trial070.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:09:46.350 INFO:teuthology.orchestra.run.trial070.stdout:/boot/efi/EFI/rocky 2026-02-12T22:09:46.351 DEBUG:teuthology.orchestra.run.trial070:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:09:46.418 INFO:teuthology.orchestra.run.trial070.stdout:no 2026-02-12T22:09:46.418 DEBUG:teuthology.orchestra.run.trial070:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:09:46.484 INFO:teuthology.orchestra.run.trial070.stdout:yes 2026-02-12T22:09:46.485 DEBUG:teuthology.orchestra.run.trial070:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:09:46.552 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial070 2026-02-12T22:09:46.553 DEBUG:teuthology.orchestra.run.trial070:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:09:46.618 INFO:teuthology.orchestra.run.trial070.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:10:13.508 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:13.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:13.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:13.621 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:13.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:13.698 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:13.698 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:13.754 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:13.755 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:13.755 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:13.755 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:14.757 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:14.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:14.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:14.866 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:14.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:14.954 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:14.954 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:15.010 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:15.010 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:15.010 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:15.010 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:16.012 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:16.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:16.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:16.123 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:16.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:16.198 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:16.198 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:16.255 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:16.255 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:16.255 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:16.255 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:16.596 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:16.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:16.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:16.708 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:16.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:16.790 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:16.790 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:16.847 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:16.847 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:16.847 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:16.847 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:17.256 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:17.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:17.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:17.367 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:17.442 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:17.442 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:17.443 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:17.500 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:17.500 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:17.500 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:17.500 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:17.848 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:17.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:17.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:17.957 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:18.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:18.032 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:18.032 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:18.090 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:18.090 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:18.090 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:18.090 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:18.501 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:18.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:18.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:18.614 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:18.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:18.689 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:18.689 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:18.747 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:18.747 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:18.747 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:18.747 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:19.091 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:19.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:19.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:19.202 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:19.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:19.278 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:19.278 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:19.335 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:19.336 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:19.336 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:19.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:19.749 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:19.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:19.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:19.860 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:19.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:19.943 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:19.943 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:20.000 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:20.000 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:20.000 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:20.000 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:20.338 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:20.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:20.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:20.448 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:20.533 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:20.533 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:20.533 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:20.590 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:20.590 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:20.590 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:20.590 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:21.002 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:21.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:21.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:21.106 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:21.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:21.193 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:21.193 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:21.251 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:21.252 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:21.252 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:21.252 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:21.591 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:21.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:21.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:21.701 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:21.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:21.779 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:21.780 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:21.836 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:21.836 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:21.837 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:21.837 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:22.253 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:22.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:22.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:22.366 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:22.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:22.440 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:22.440 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:22.498 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:22.499 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:22.499 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:22.499 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:22.838 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:22.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:22.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:22.949 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:23.025 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:23.025 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:23.025 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:23.082 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:23.083 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:23.083 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:23.083 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:23.500 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:23.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:23.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:23.611 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:23.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:23.689 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:23.689 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:23.746 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:23.747 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:23.747 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:23.747 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:24.084 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:24.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:24.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:24.196 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:24.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:24.279 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:24.279 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:24.336 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:24.337 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:24.337 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:24.337 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:24.749 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:24.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:24.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:24.860 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:24.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:24.941 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:24.941 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:24.999 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:25.000 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:25.000 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:25.000 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:25.338 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:25.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:25.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:25.449 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:25.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:25.531 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:25.532 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:25.588 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:25.589 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:25.589 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:25.589 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:26.001 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:26.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:26.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:26.104 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:26.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:26.186 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:26.186 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:26.243 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:26.243 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:26.243 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:26.243 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:26.591 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:26.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:26.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:26.701 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:26.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:26.784 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:26.784 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:26.842 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:26.843 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:26.843 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:26.843 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:27.246 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:27.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:27.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:27.356 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:27.435 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:27.435 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:27.435 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:27.492 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:27.493 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:27.493 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:27.493 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:27.845 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:27.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:27.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:27.955 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:28.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:28.049 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:28.049 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:28.106 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:28.106 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:28.107 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:28.107 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:28.494 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:28.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:28.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:28.604 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:28.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:28.690 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:28.690 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:28.748 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:28.749 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:28.749 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:28.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:29.108 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:29.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:29.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:29.219 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:29.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:29.298 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:29.298 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:29.354 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:29.355 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:29.355 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:29.355 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:29.750 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:29.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:29.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:29.857 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:29.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:29.930 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:29.930 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:29.987 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:29.987 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:29.987 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:29.987 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:30.355 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:30.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:30.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:30.463 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:30.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:30.544 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:30.545 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:30.601 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:30.602 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:30.602 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:30.602 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:30.988 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:30.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:30.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:31.093 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:31.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:31.168 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:31.168 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:31.226 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:31.227 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:31.227 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:31.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:31.603 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:31.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:31.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:31.714 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:31.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:31.792 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:31.792 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:31.849 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:31.849 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:31.849 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:31.849 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:32.228 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:32.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:32.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:32.338 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:32.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:32.413 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:32.413 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:32.472 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:32.473 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:32.473 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:32.473 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:32.851 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:32.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:32.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:32.960 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:33.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:33.042 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:33.042 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:33.098 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:33.099 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:33.099 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:33.099 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:33.474 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:33.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:33.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:33.582 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:33.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:33.656 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:33.656 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:33.713 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:33.714 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:33.714 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:33.714 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:34.100 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:34.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:34.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:34.210 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:34.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:34.289 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:34.289 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:34.345 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:34.345 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:34.346 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:34.346 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:34.716 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:34.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:34.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:34.825 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:34.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:34.900 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:34.900 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:34.957 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:34.958 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:34.958 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:34.958 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:35.347 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:35.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:35.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:35.457 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:35.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:35.536 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:35.536 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:35.593 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:35.594 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:35.594 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:35.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:35.959 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:35.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:35.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:36.069 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:36.150 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:36.150 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:36.150 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:36.207 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:36.207 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:36.207 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:36.207 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:36.595 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:36.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:36.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:36.705 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:36.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:36.782 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:36.782 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:36.839 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:36.840 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:36.840 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:36.840 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:37.208 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:37.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:37.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:37.318 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:37.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:37.433 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:37.433 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:37.490 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:37.490 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:37.490 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:37.490 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:37.841 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:37.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:37.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:37.952 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:38.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:38.033 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:38.033 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:38.090 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:38.091 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:38.091 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:38.091 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:38.491 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:38.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:38.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:38.604 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:38.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:38.681 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:38.681 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:38.738 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:38.738 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:38.738 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:38.739 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:39.092 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:39.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:39.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:39.203 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:39.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:39.290 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:39.290 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:39.347 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:39.347 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:39.348 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:39.348 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:39.740 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:39.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:39.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:39.852 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:39.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:39.937 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:39.937 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:39.994 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:39.994 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:39.994 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:39.995 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:40.349 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:40.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:40.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:40.460 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:40.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:40.548 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:40.548 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:40.605 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:40.606 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:40.606 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:40.606 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:40.996 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:40.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:40.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:41.111 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:41.187 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:41.188 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:41.188 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:41.244 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:41.245 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:41.245 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:41.245 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:41.607 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:41.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:41.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:41.718 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:41.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:41.794 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:41.794 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:41.852 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:41.852 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:41.852 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:41.852 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:42.246 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:42.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:42.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:42.359 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:42.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:42.432 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:42.432 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:42.489 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:42.489 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:42.490 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:42.490 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:42.854 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:42.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:42.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:42.968 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:43.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:43.052 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:43.052 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:43.111 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:43.111 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:43.111 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:43.111 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:43.491 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:43.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:43.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:43.603 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:43.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:43.683 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:43.683 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:43.740 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:43.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:43.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:43.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:44.113 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:44.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:44.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:44.222 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:44.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:44.299 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:44.299 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:44.356 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:44.356 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:44.356 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:44.356 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:44.743 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:44.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:44.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:44.856 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:44.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:44.938 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:44.938 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:44.997 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:44.997 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:44.997 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:44.997 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:45.358 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:45.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:45.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:45.467 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:45.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:45.554 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:45.554 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:45.610 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:45.611 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:45.611 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:45.611 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:45.998 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:45.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:46.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:46.111 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:46.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:46.182 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:46.182 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:46.239 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:46.239 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:46.239 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:46.240 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:46.612 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:46.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:46.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:46.723 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:46.799 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:46.799 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:46.800 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:46.857 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:46.857 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:46.858 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:46.858 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:47.241 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:47.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:47.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:47.310 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:47.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:47.397 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:47.397 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:47.454 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:47.454 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:47.454 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:47.454 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:47.859 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:47.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:47.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:47.969 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:48.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:48.042 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:48.043 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:48.100 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:48.100 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:48.100 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:48.101 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:48.455 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:48.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:48.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:48.566 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:48.644 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:48.644 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:48.644 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:48.702 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:48.703 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:48.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:48.703 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:49.102 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:49.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:49.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:49.212 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:49.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:49.296 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:49.296 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:49.352 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:49.352 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:49.353 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:49.353 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:49.705 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:49.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:49.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:49.790 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:49.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:49.870 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:49.870 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:49.927 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:49.928 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:49.928 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:49.928 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:50.353 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:50.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:50.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:50.463 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:50.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:50.535 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:50.535 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:50.592 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:50.593 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:50.593 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:50.593 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:50.929 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:50.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:50.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:51.039 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:51.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:51.121 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:51.121 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:51.178 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:51.178 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:51.178 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:51.178 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:51.594 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:51.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:51.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:51.705 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:51.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:51.789 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:51.789 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:51.846 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:51.846 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:51.847 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:51.847 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:52.180 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:52.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:52.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:52.290 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:52.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:52.369 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:52.369 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:52.426 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:52.427 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:52.427 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:52.427 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:52.848 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:52.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:52.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:52.960 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:53.048 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:53.049 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:53.049 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:53.107 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:53.107 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:53.107 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:53.107 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:53.428 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:53.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:53.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:53.537 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:53.617 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:53.617 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:53.617 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:53.675 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:53.675 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:53.675 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:53.675 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:54.108 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:54.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:54.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:54.218 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:54.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:54.306 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:54.307 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:54.364 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:54.364 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:54.364 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:54.364 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:54.677 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:54.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:54.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:54.782 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:54.867 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:54.867 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:54.867 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:54.925 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:54.925 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:54.926 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:54.926 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:55.365 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:55.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:55.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:55.426 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:55.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:55.501 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:55.501 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:55.560 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:55.560 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:55.561 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:55.561 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:55.927 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:55.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:55.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:56.033 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:56.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:56.104 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:56.104 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:56.161 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:56.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:56.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:56.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:56.562 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:56.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:56.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:56.671 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:56.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:56.747 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:56.747 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:56.804 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:56.805 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:56.805 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:56.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:57.162 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:57.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:57.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:57.272 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:57.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:57.358 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:57.359 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:57.416 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:57.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:57.416 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:57.416 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:57.806 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:57.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:57.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:57.919 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:57.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:57.999 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:57.999 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:58.056 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:58.057 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:58.057 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:58.057 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:58.418 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:58.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:58.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:58.528 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:58.618 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:58.618 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:58.618 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:58.675 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:58.675 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:58.675 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:58.675 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:59.059 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:10:59.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:59.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:59.168 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:10:59.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:10:59.250 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:59.251 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:10:59.308 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:59.308 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:59.308 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:59.308 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:10:59.676 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:10:59.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:59.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:10:59.789 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:10:59.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:10:59.874 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:10:59.874 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:10:59.931 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:10:59.931 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:10:59.931 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:10:59.931 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:00.309 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:00.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:00.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:00.420 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:00.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:00.494 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:00.494 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:00.551 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:00.551 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:00.551 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:00.551 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:00.932 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:00.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:00.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:01.043 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:01.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:01.121 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:01.121 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:01.178 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:01.178 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:01.179 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:01.179 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:01.552 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:01.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:01.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:01.663 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:01.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:01.746 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:01.746 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:01.803 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:01.803 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:01.803 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:01.803 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:02.180 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:02.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:02.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:02.290 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:02.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:02.364 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:02.364 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:02.422 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:02.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:02.422 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:02.422 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:02.805 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:02.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:02.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:02.881 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:02.964 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:02.964 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:02.964 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:03.022 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:03.022 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:03.022 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:03.022 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:03.424 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:03.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:03.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:03.537 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:03.621 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:03.622 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:03.622 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:03.680 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:03.680 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:03.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:03.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:04.023 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:04.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:04.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:04.138 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:04.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:04.219 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:04.219 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:04.276 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:04.276 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:04.276 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:04.276 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:04.681 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:04.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:04.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:04.791 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:04.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:04.872 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:04.873 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:04.930 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:04.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:04.931 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:04.931 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:05.278 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:05.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:05.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:05.388 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:05.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:05.469 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:05.469 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:05.525 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:05.526 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:05.526 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:05.526 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:05.932 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:05.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:05.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:06.041 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:06.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:06.123 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:06.123 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:06.181 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:06.182 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:06.182 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:06.182 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:06.527 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:06.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:06.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:06.637 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:06.708 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:06.708 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:06.709 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:06.765 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:06.765 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:06.765 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:06.765 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:07.183 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:07.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:07.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:07.296 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:07.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:07.378 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:07.378 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:07.435 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:07.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:07.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:07.436 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:07.766 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:07.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:07.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:07.875 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:07.957 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:07.957 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:07.958 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:08.014 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:08.015 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:08.015 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:08.015 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:08.437 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:08.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:08.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:08.547 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:08.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:08.633 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:08.633 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:08.691 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:08.691 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:08.692 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:08.692 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:09.017 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:09.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:09.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:09.126 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:09.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:09.200 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:09.200 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:09.257 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:09.258 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:09.258 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:09.258 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:09.693 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:09.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:09.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:09.803 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:09.879 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:09.879 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:09.879 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:09.937 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:09.937 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:09.937 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:09.938 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:10.260 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:10.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:10.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:10.369 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:10.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:10.455 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:10.455 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:10.512 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:10.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:10.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:10.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:10.939 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:10.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:10.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:11.050 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:11.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:11.137 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:11.137 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:11.194 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:11.194 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:11.194 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:11.194 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:11.515 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:11.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:11.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:11.630 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:11.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:11.704 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:11.704 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:11.762 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:11.763 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:11.763 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:11.763 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:12.196 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:12.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:12.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:12.307 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:12.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:12.392 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:12.392 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:12.449 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:12.449 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:12.450 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:12.450 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:12.765 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:12.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:12.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:12.872 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:12.957 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:12.957 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:12.957 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:13.014 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:13.014 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:13.014 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:13.014 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:13.451 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:13.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:13.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:13.564 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:13.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:13.650 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:13.651 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:13.708 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:13.708 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:13.708 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:13.708 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:14.015 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:14.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:14.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:14.080 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:14.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:14.154 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:14.154 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:14.211 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:14.211 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:14.211 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:14.211 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:14.709 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:14.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:14.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:14.821 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:14.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:14.905 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:14.905 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:14.962 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:14.962 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:14.962 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:14.963 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:15.212 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:15.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:15.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:15.322 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:15.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:15.394 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:15.394 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:15.451 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:15.452 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:15.452 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:15.452 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:15.964 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:15.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:15.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:16.075 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:16.160 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:16.160 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:16.160 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:16.219 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:16.219 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:16.219 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:16.219 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:16.454 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:16.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:16.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:16.552 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:16.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:16.630 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:16.630 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:16.687 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:16.688 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:16.688 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:16.688 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:17.220 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:17.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:17.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:17.331 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:17.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:17.413 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:17.413 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:17.470 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:17.470 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:17.470 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:17.471 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:17.689 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:17.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:17.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:17.793 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:17.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:17.878 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:17.878 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:17.935 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:17.935 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:17.935 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:17.935 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:18.472 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:18.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:18.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:18.551 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:18.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:18.628 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:18.628 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:18.684 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:18.684 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:18.684 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:18.684 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:18.936 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:18.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:18.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:19.046 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:19.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:19.123 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:19.124 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:19.180 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:19.180 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:19.180 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:19.180 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:19.684 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:19.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:19.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:19.748 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:19.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:19.822 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:19.822 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:19.880 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:19.880 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:19.880 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:19.881 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:20.181 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:20.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:20.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:20.294 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:20.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:20.370 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:20.370 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:20.427 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:20.428 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:20.428 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:20.428 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:20.882 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:20.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:20.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:20.992 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:21.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:21.079 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:21.079 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:21.137 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:21.138 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:21.138 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:21.138 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:21.430 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:21.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:21.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:21.540 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:21.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:21.616 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:21.616 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:21.674 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:21.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:21.675 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:21.675 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:22.139 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:22.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:22.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:22.254 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:22.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:22.333 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:22.334 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:22.391 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:22.391 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:22.391 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:22.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:22.676 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:22.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:22.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:22.778 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:22.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:22.860 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:22.860 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:22.917 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:22.918 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:22.918 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:22.918 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:23.393 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:23.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:23.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:23.477 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:23.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:23.565 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:23.566 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:23.623 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:23.623 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:23.623 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:23.623 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:23.919 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:23.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:23.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:24.016 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:24.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:24.104 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:24.104 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:24.160 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:24.160 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:24.160 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:24.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:24.625 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:24.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:24.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:24.736 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:24.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:24.826 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:24.826 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:24.882 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:24.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:24.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:24.883 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:25.161 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:25.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:25.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:25.275 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:25.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:25.364 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:25.364 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:25.422 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:25.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:25.422 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:25.422 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:25.884 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:25.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:25.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:25.996 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:26.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:26.078 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:26.078 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:26.137 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:26.137 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:26.138 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:26.138 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:26.423 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:26.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:26.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:26.531 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:26.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:26.626 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:26.626 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:26.684 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:26.684 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:26.685 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:26.685 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:27.139 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:27.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:27.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:27.251 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:27.329 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:27.330 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:27.330 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:27.388 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:27.389 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:27.389 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:27.389 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:27.686 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:27.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:27.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:27.795 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:27.871 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:27.871 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:27.872 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:27.928 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:27.929 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:27.929 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:27.929 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:28.390 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:28.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:28.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:28.481 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:28.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:28.566 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:28.566 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:28.623 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:28.623 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:28.623 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:28.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:28.931 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:28.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:28.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:29.042 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:29.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:29.125 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:29.125 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:29.182 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:29.182 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:29.183 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:29.183 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:29.625 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:29.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:29.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:29.735 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:29.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:29.813 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:29.813 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:29.870 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:29.870 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:29.870 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:29.871 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:30.184 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:30.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:30.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:30.294 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:30.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:30.369 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:30.369 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:30.427 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:30.427 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:30.427 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:30.427 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:30.872 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:30.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:30.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:30.979 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:31.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:31.054 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:31.055 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:31.111 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:31.111 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:31.111 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:31.112 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:31.429 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:31.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:31.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:31.493 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:31.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:31.580 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:31.580 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:31.638 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:31.638 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:31.638 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:31.638 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:32.113 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:32.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:32.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:32.223 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:32.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:32.299 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:32.299 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:32.357 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:32.357 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:32.357 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:32.357 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:32.639 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:32.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:32.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:32.781 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:32.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:32.865 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:32.865 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:32.921 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:32.922 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:32.922 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:32.922 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:33.358 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:33.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:33.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:33.469 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:33.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:33.544 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:33.544 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:33.601 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:33.601 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:33.601 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:33.601 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:33.923 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:33.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:33.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:34.035 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:34.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:34.108 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:34.109 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:34.166 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:34.166 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:34.167 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:34.167 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:34.602 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:34.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:34.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:34.713 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:34.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:34.794 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:34.795 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:34.852 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:34.852 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:34.853 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:34.853 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:35.168 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:35.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:35.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:35.280 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:35.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:35.358 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:35.358 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:35.416 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:35.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:35.416 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:35.417 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:35.854 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:35.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:35.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:35.964 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:36.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:36.038 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:36.038 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:36.095 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:36.095 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:36.096 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:36.096 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:36.418 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:36.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:36.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:36.525 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:36.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:36.604 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:36.604 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:36.661 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:36.661 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:36.662 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:36.662 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:37.097 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:37.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:37.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:37.209 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:37.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:37.288 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:37.288 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:37.345 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:37.346 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:37.346 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:37.346 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:37.663 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:37.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:37.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:37.773 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:37.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:37.858 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:37.858 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:37.914 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:37.915 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:37.915 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:37.915 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:38.348 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:38.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:38.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:38.461 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:38.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:38.541 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:38.541 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:38.599 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:38.600 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:38.600 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:38.600 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:38.917 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:38.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:38.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:39.020 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:39.095 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:39.095 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:39.095 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:39.152 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:39.152 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:39.152 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:39.152 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:39.601 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:39.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:39.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:39.709 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:39.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:39.782 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:39.782 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:39.839 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:39.839 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:39.839 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:39.839 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:40.154 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:40.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:40.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:40.264 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:40.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:40.347 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:40.348 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:40.404 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:40.405 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:40.405 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:40.405 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:40.840 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:40.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:40.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:40.952 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:41.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:41.035 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:41.035 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:41.092 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:41.092 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:41.092 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:41.093 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:41.406 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:41.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:41.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:41.517 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:41.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:41.592 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:41.592 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:41.649 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:41.649 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:41.649 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:41.650 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:42.094 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:42.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:42.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:42.193 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:42.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:42.278 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:42.278 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:42.334 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:42.334 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:42.334 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:42.334 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:42.651 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:42.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:42.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:42.718 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:42.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:42.801 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:42.801 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:42.858 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:42.859 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:42.859 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:42.859 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:43.335 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:43.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:43.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:43.446 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:43.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:43.526 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:43.526 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:43.583 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:43.584 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:43.584 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:43.584 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:43.860 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:43.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:43.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:43.972 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:44.055 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:44.055 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:44.055 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:44.113 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:44.113 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:44.114 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:44.114 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:44.586 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:44.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:44.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:44.669 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:44.757 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:44.757 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:44.757 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:44.816 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:44.816 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:44.816 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:44.816 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:45.115 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:45.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:45.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:45.226 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:45.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:45.305 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:45.305 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:45.362 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:45.362 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:45.363 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:45.363 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:45.817 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:45.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:45.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:45.923 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:45.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:45.998 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:45.998 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:46.054 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:46.054 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:46.055 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:46.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:46.364 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:46.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:46.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:46.475 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:46.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:46.552 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:46.552 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:46.610 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:46.610 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:46.611 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:46.611 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:47.056 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:47.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:47.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:47.171 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:47.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:47.250 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:47.250 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:47.306 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:47.307 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:47.307 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:47.307 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:47.612 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:47.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:47.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:47.722 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:47.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:47.796 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:47.796 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:47.853 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:47.853 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:47.853 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:47.853 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:48.309 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:48.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:48.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:48.419 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:48.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:48.500 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:48.500 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:48.558 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:48.558 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:48.558 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:48.558 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:48.854 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:48.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:48.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:48.964 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:49.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:49.051 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:49.051 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:49.109 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:49.109 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:49.109 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:49.109 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:49.559 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:49.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:49.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:49.669 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:49.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:49.748 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:49.748 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:49.805 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:49.806 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:49.806 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:49.806 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:50.111 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:50.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:50.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:50.223 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:50.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:50.300 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:50.301 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:50.357 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:50.357 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:50.357 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:50.357 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:50.807 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:50.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:50.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:50.920 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:50.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:50.992 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:50.993 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:51.050 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:51.050 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:51.050 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:51.050 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:51.358 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:51.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:51.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:51.467 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:51.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:51.541 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:51.541 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:51.598 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:51.599 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:51.599 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:51.599 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:52.051 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:52.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:52.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:52.161 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:52.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:52.249 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:52.249 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:52.306 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:52.307 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:52.307 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:52.307 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:52.600 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:52.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:52.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:52.710 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:52.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:52.792 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:52.792 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:52.849 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:52.849 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:52.850 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:52.850 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:53.308 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:53.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:53.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:53.419 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:53.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:53.491 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:53.492 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:53.549 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:53.550 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:53.550 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:53.550 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:53.851 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:53.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:53.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:53.961 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:54.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:54.050 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:54.050 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:54.107 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:54.107 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:54.107 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:54.108 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:54.552 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:54.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:54.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:54.663 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:54.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:54.745 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:54.745 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:54.802 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:54.802 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:54.802 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:54.803 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:55.109 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:55.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:55.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:55.218 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:55.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:55.304 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:55.304 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:55.362 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:55.363 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:55.363 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:55.363 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:55.803 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:55.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:55.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:55.920 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:56.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:56.007 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:56.007 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:56.064 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:56.064 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:56.065 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:56.065 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:56.364 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:56.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:56.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:56.428 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:56.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:56.518 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:56.518 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:56.576 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:56.577 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:56.577 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:56.577 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:57.066 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:57.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:57.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:57.177 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:57.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:57.267 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:57.268 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:57.326 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:57.326 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:57.326 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:57.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:57.578 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:57.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:57.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:57.690 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:57.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:57.770 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:57.770 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:57.828 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:57.829 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:57.829 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:57.829 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:58.327 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:58.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:58.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:58.438 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:58.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:58.516 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:58.516 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:58.572 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:58.573 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:58.573 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:58.573 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:58.830 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:11:58.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:58.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:58.893 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:11:58.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:11:58.982 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:58.982 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:11:59.040 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:59.041 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:59.041 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:59.041 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:11:59.573 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:11:59.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:59.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:11:59.636 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:11:59.708 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:11:59.708 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:11:59.708 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:11:59.764 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:11:59.764 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:11:59.764 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:11:59.764 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:00.042 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:00.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:00.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:00.153 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:00.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:00.240 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:00.241 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:00.297 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:00.298 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:00.298 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:00.298 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:00.766 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:00.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:00.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:00.876 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:00.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:00.960 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:00.960 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:01.017 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:01.017 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:01.017 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:01.017 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:01.299 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:01.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:01.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:01.409 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:01.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:01.496 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:01.496 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:01.553 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:01.553 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:01.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:01.553 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:02.019 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:02.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:02.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:02.130 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:02.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:02.215 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:02.215 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:02.271 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:02.272 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:02.272 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:02.272 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:02.554 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:02.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:02.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:02.664 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:02.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:02.747 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:02.747 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:02.805 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:02.805 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:02.806 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:02.806 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:03.273 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:03.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:03.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:03.386 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:03.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:03.461 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:03.462 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:03.519 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:03.520 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:03.520 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:03.520 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:03.807 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:03.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:03.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:03.916 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:03.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:03.994 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:03.994 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:04.050 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:04.051 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:04.051 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:04.051 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:04.521 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:04.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:04.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:04.634 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:04.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:04.710 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:04.710 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:04.768 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:04.768 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:04.768 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:04.768 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:05.052 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:05.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:05.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:05.162 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:05.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:05.243 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:05.243 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:05.301 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:05.302 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:05.302 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:05.302 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:05.769 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:05.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:05.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:05.879 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:05.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:05.960 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:05.960 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:06.017 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:06.017 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:06.017 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:06.017 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:06.303 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:06.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:06.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:06.413 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:06.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:06.491 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:06.491 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:06.550 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:06.550 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:06.551 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:06.551 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:07.018 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:07.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:07.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:07.130 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:07.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:07.206 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:07.206 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:07.263 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:07.264 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:07.264 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:07.264 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:07.552 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:07.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:07.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:07.662 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:07.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:07.738 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:07.738 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:07.795 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:07.796 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:07.796 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:07.796 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:08.265 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:08.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:08.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:08.376 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:08.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:08.448 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:08.448 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:08.506 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:08.506 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:08.506 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:08.506 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:08.797 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:08.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:08.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:08.907 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:08.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:08.990 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:08.990 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:09.046 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:09.047 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:09.047 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:09.047 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:09.507 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:09.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:09.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:09.618 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:09.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:09.700 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:09.700 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:09.758 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:09.758 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:09.758 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:09.758 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:10.048 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:10.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:10.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:10.159 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:10.233 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:10.233 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:10.233 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:10.290 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:10.290 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:10.290 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:10.290 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:10.759 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:10.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:10.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:10.871 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:10.947 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:10.947 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:10.947 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:11.004 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:11.005 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:11.005 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:11.005 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:11.291 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:11.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:11.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:11.399 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:11.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:11.485 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:11.485 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:11.543 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:11.543 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:11.543 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:11.543 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:12.006 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:12.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:12.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:12.080 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:12.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:12.156 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:12.156 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:12.216 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:12.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:12.216 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:12.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:12.545 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:12.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:12.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:12.655 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:12.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:12.735 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:12.735 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:12.792 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:12.792 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:12.792 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:12.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:13.217 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:13.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:13.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:13.328 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:13.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:13.405 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:13.405 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:13.462 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:13.462 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:13.462 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:13.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:13.793 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:13.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:13.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:13.903 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:13.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:13.980 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:13.980 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:14.037 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:14.037 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:14.037 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:14.037 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:14.464 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:14.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:14.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:14.574 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:14.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:14.651 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:14.651 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:14.708 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:14.708 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:14.708 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:14.708 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:15.038 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:15.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:15.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:15.151 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:15.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:15.224 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:15.224 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:15.282 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:15.282 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:15.283 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:15.283 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:15.710 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:15.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:15.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:15.773 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:15.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:15.851 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:15.851 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:15.909 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:15.909 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:15.910 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:15.910 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:16.284 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:16.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:16.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:16.394 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:16.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:16.469 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:16.469 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:16.528 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:16.528 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:16.528 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:16.528 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:16.912 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:16.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:16.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:17.023 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:17.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:17.102 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:17.102 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:17.161 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:17.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:17.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:17.162 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:17.530 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:17.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:17.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:17.639 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:17.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:17.729 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:17.730 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:17.787 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:17.788 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:17.788 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:17.788 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:18.162 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:18.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:18.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:18.274 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:18.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:18.351 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:18.351 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:18.407 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:18.407 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:18.408 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:18.408 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:18.789 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:18.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:18.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:18.900 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:18.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:18.974 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:18.974 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:19.031 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:19.031 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:19.031 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:19.031 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:19.409 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:19.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:19.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:19.513 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:19.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:19.594 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:19.595 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:19.652 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:19.652 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:19.653 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:19.653 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:20.033 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:20.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:20.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:20.142 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:20.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:20.223 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:20.223 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:20.280 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:20.280 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:20.280 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:20.280 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:20.653 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:20.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:20.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:20.764 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:20.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:20.854 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:20.854 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:20.911 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:20.911 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:20.912 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:20.912 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:21.282 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:21.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:21.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:21.392 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:21.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:21.466 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:21.466 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:21.523 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:21.524 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:21.524 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:21.524 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:21.913 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:21.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:21.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:21.977 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:22.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:22.064 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:22.064 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:22.120 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:22.120 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:22.121 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:22.121 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:22.525 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:22.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:22.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:22.635 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:22.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:22.709 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:22.709 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:22.766 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:22.766 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:22.766 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:22.766 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:23.121 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:23.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:23.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:23.231 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:23.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:23.319 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:23.319 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:23.376 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:23.377 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:23.377 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:23.377 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:23.768 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:23.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:23.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:23.878 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:23.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:23.954 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:23.954 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:24.011 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:24.011 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:24.011 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:24.011 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:24.378 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:24.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:24.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:24.488 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:24.562 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:24.562 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:24.562 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:24.619 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:24.619 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:24.619 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:24.619 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:25.013 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:25.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:25.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:25.122 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:25.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:25.205 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:25.205 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:25.262 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:25.263 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:25.263 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:25.263 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:25.621 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:25.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:25.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:25.731 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:25.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:25.805 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:25.805 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:25.862 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:25.862 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:25.862 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:25.862 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:26.264 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:26.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:26.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:26.374 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:26.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:26.451 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:26.451 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:26.509 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:26.510 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:26.510 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:26.510 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:26.863 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:26.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:26.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:26.927 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:27.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:27.003 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:27.003 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:27.060 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:27.060 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:27.060 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:27.060 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:27.511 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:27.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:27.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:27.583 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:27.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:27.669 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:27.669 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:27.728 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:27.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:27.729 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:27.729 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:28.062 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:28.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:28.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:28.126 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:28.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:28.202 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:28.203 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:28.260 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:28.261 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:28.261 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:28.261 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:28.730 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:28.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:28.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:28.861 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:28.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:28.941 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:28.941 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:28.997 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:28.998 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:28.998 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:28.998 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:29.263 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:29.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:29.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:29.376 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:29.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:29.451 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:29.451 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:29.508 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:29.509 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:29.509 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:29.509 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:29.999 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:30.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:30.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:30.107 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:30.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:30.193 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:30.193 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:30.250 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:30.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:30.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:30.250 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:30.509 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:30.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:30.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:30.618 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:30.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:30.697 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:30.697 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:30.753 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:30.754 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:30.754 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:30.754 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:31.251 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:31.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:31.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:31.360 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:31.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:31.440 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:31.440 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:31.498 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:31.499 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:31.499 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:31.499 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:31.755 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:31.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:31.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:31.836 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:31.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:31.911 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:31.911 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:31.967 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:31.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:31.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:31.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:32.500 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:32.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:32.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:32.608 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:32.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:32.690 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:32.690 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:32.747 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:32.747 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:32.747 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:32.747 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:32.969 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:32.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:32.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:33.079 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:33.160 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:33.160 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:33.160 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:33.216 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:33.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:33.216 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:33.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:33.749 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:33.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:33.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:33.858 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:33.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:33.935 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:33.935 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:33.992 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:33.993 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:33.993 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:33.993 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:34.217 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:34.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:34.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:34.328 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:34.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:34.411 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:34.411 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:34.468 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:34.468 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:34.468 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:34.468 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:34.994 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:34.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:34.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:35.105 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:35.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:35.186 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:35.186 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:35.243 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:35.243 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:35.243 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:35.243 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:35.470 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:35.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:35.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:35.533 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:35.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:35.616 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:35.616 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:35.672 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:35.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:35.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:35.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:36.244 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:36.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:36.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:36.354 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:36.439 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:36.440 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:36.440 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:36.497 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:36.497 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:36.498 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:36.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:36.673 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:36.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:36.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:36.780 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:36.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:36.863 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:36.864 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:36.921 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:36.921 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:36.921 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:36.921 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:37.499 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:37.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:37.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:37.609 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:37.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:37.693 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:37.693 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:37.750 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:37.750 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:37.750 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:37.750 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:37.923 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:37.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:37.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:38.033 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:38.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:38.116 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:38.116 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:38.173 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:38.173 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:38.173 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:38.173 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:38.752 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:38.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:38.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:38.863 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:38.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:38.949 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:38.949 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:39.006 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:39.006 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:39.006 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:39.007 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:39.174 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:39.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:39.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:39.284 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:39.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:39.366 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:39.367 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:39.423 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:39.424 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:39.424 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:39.424 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:40.008 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:40.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:40.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:40.119 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:40.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:40.202 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:40.202 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:40.258 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:40.259 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:40.259 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:40.259 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:40.425 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:40.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:40.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:40.535 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:40.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:40.622 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:40.622 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:40.679 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:40.679 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:40.679 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:40.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:41.261 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:41.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:41.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:41.371 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:41.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:41.448 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:41.448 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:41.506 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:41.506 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:41.506 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:41.506 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:41.680 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:41.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:41.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:41.790 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:41.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:41.870 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:41.870 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:41.926 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:41.926 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:41.926 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:41.926 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:42.508 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:42.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:42.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:42.570 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:42.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:42.651 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:42.651 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:42.710 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:42.710 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:42.710 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:42.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:42.927 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:42.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:42.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:43.033 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:43.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:43.118 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:43.118 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:43.175 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:43.175 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:43.175 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:43.175 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:43.710 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:43.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:43.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:43.821 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:43.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:43.901 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:43.902 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:43.959 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:43.959 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:43.960 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:43.960 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:44.176 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:44.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:44.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:44.287 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:44.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:44.361 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:44.361 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:44.419 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:44.420 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:44.420 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:44.420 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:44.961 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:44.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:44.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:45.073 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:45.147 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:45.147 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:45.147 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:45.205 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:45.205 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:45.205 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:45.206 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:45.421 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:45.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:45.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:45.519 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:45.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:45.605 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:45.605 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:45.663 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:45.664 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:45.664 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:45.664 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:46.207 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:46.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:46.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:46.318 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:46.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:46.397 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:46.398 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:46.455 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:46.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:46.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:46.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:46.665 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:46.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:46.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:46.775 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:46.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:46.851 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:46.852 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:46.908 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:46.909 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:46.909 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:46.909 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:47.456 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:47.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:47.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:47.568 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:47.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:47.652 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:47.652 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:47.710 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:47.710 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:47.710 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:47.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:47.911 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:47.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:47.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:48.021 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:48.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:48.094 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:48.094 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:48.152 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:48.152 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:48.152 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:48.152 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:48.711 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:48.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:48.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:48.821 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:48.906 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:48.907 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:48.907 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:48.964 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:48.964 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:48.965 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:48.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:49.153 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:49.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:49.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:49.265 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:49.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:49.341 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:49.341 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:49.398 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:49.398 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:49.398 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:49.398 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:49.966 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:49.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:49.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:50.075 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:50.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:50.161 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:50.161 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:50.217 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:50.218 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:50.218 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:50.218 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:50.399 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:50.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:50.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:50.510 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:50.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:50.597 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:50.597 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:50.656 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:50.657 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:50.657 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:50.657 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:51.219 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:51.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:51.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:51.330 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:51.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:51.402 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:51.403 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:51.459 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:51.459 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:51.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:51.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:51.658 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:51.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:51.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:51.770 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:51.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:51.852 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:51.852 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:51.910 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:51.910 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:51.911 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:51.911 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:52.460 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:52.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:52.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:52.572 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:52.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:52.648 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:52.648 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:52.705 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:52.706 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:52.706 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:52.706 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:52.912 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:52.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:52.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:53.022 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:53.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:53.101 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:53.101 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:53.158 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:53.158 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:53.158 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:53.159 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:53.708 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:53.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:53.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:53.819 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:53.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:53.903 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:53.904 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:53.961 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:53.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:53.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:53.962 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:54.160 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:54.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:54.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:54.272 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:54.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:54.351 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:54.351 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:54.408 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:54.409 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:54.409 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:54.409 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:54.963 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:54.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:54.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:55.074 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:55.151 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:55.152 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:55.152 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:55.209 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:55.209 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:55.209 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:55.209 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:55.410 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:55.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:55.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:55.520 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:55.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:55.607 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:55.607 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:55.664 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:55.664 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:55.664 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:55.664 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:56.211 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:56.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:56.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:56.321 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:56.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:56.409 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:56.409 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:56.467 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:56.467 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:56.467 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:56.467 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:56.666 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:56.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:56.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:56.776 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:56.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:56.863 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:56.863 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:56.920 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:56.921 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:56.921 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:56.921 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:57.469 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:57.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:57.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:57.578 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:57.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:57.657 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:57.657 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:57.714 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:57.714 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:57.715 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:57.715 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:57.922 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:57.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:57.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:58.033 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:58.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:58.113 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:58.113 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:58.170 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:58.171 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:58.171 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:58.171 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:58.716 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:58.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:58.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:58.827 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:12:58.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:58.908 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:58.908 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:12:58.965 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:58.966 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:58.966 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:58.966 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:59.172 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:12:59.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:59.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:12:59.283 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:12:59.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:12:59.365 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:12:59.365 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:12:59.422 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:12:59.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:12:59.422 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:12:59.422 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:12:59.967 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:12:59.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:12:59.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:00.078 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:00.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:00.156 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:00.156 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:00.213 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:00.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:00.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:00.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:00.423 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:00.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:00.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:00.531 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:00.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:00.607 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:00.607 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:00.664 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:00.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:00.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:00.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:01.215 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:01.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:01.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:01.324 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:01.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:01.411 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:01.411 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:01.468 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:01.468 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:01.468 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:01.468 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:01.666 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:01.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:01.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:01.775 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:01.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:01.861 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:01.861 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:01.919 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:01.919 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:01.920 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:01.920 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:02.470 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:02.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:02.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:02.532 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:02.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:02.623 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:02.623 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:02.681 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:02.681 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:02.681 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:02.681 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:02.921 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:02.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:02.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:03.032 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:03.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:03.110 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:03.110 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:03.166 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:03.167 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:03.167 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:03.167 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:03.683 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:03.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:03.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:03.792 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:03.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:03.878 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:03.878 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:03.935 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:03.935 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:03.935 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:03.936 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:04.168 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:04.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:04.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:04.279 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:04.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:04.361 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:04.362 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:04.419 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:04.419 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:04.419 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:04.419 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:04.937 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:04.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:04.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:05.046 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:05.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:05.135 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:05.135 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:05.192 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:05.192 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:05.192 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:05.192 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:05.421 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:05.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:05.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:05.530 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:05.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:05.613 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:05.613 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:05.672 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:05.672 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:05.672 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:05.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:06.193 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:06.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:06.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:06.304 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:06.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:06.380 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:06.380 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:06.439 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:06.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:06.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:06.440 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:06.674 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:06.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:06.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:06.784 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:06.859 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:06.860 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:06.860 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:06.917 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:06.917 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:06.917 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:06.917 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:07.441 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:07.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:07.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:07.552 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:07.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:07.626 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:07.627 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:07.684 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:07.684 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:07.684 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:07.685 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:07.918 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:07.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:07.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:08.031 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:08.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:08.106 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:08.106 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:08.162 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:08.162 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:08.162 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:08.162 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:08.686 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:08.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:08.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:08.796 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:08.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:08.877 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:08.877 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:08.935 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:08.935 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:08.935 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:08.935 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:09.163 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:09.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:09.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:09.273 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:09.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:09.351 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:09.351 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:09.409 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:09.409 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:09.409 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:09.410 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:09.936 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:09.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:09.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:10.047 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:10.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:10.121 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:10.122 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:10.179 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:10.179 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:10.179 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:10.180 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:10.411 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:10.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:10.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:10.521 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:10.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:10.601 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:10.602 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:10.659 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:10.659 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:10.659 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:10.659 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:11.180 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:11.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:11.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:11.290 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:11.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:11.370 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:11.370 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:11.426 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:11.427 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:11.427 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:11.427 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:11.661 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:11.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:11.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:11.770 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:11.855 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:11.855 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:11.855 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:11.913 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:11.914 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:11.914 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:11.914 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:12.428 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:12.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:12.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:12.536 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:12.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:12.612 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:12.612 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:12.668 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:12.669 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:12.669 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:12.669 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:12.916 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:12.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:12.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:12.991 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:13.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:13.073 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:13.073 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:13.131 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:13.131 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:13.132 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:13.132 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:13.670 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:13.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:13.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:13.745 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:13.820 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:13.820 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:13.821 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:13.878 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:13.878 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:13.878 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:13.878 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:14.133 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:14.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:14.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:14.244 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:14.320 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:14.320 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:14.320 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:14.378 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:14.378 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:14.378 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:14.379 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:14.880 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:14.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:14.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:14.990 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:15.068 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:15.068 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:15.069 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:15.126 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:15.126 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:15.126 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:15.127 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:15.380 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:15.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:15.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:15.491 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:15.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:15.565 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:15.565 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:15.623 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:15.623 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:15.623 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:15.623 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:16.128 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:16.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:16.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:16.238 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:16.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:16.308 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:16.308 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:16.365 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:16.365 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:16.365 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:16.365 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:16.625 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:16.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:16.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:16.700 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:16.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:16.777 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:16.777 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:16.835 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:16.835 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:16.836 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:16.836 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:17.366 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:17.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:17.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:17.439 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:17.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:17.519 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:17.519 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:17.577 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:17.578 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:17.578 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:17.578 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:17.837 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:17.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:17.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:17.948 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:18.023 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:18.023 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:18.023 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:18.082 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:18.082 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:18.083 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:18.083 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:18.579 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:18.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:18.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:18.689 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:18.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:18.763 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:18.764 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:18.820 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:18.820 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:18.820 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:18.820 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:19.083 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:19.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:19.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:19.194 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:19.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:19.267 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:19.267 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:19.325 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:19.325 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:19.325 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:19.325 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:19.821 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:19.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:19.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:19.910 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:19.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:19.989 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:19.990 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:20.047 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:20.047 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:20.047 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:20.048 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:20.327 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:20.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:20.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:20.437 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:20.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:20.507 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:20.508 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:20.565 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:20.565 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:20.565 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:20.565 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:21.049 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:21.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:21.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:21.159 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:21.233 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:21.233 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:21.233 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:21.290 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:21.290 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:21.291 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:21.291 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:21.566 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:21.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:21.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:21.677 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:21.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:21.758 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:21.758 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:21.816 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:21.816 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:21.816 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:21.816 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:22.292 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:22.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:22.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:22.402 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:22.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:22.475 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:22.475 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:22.532 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:22.532 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:22.532 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:22.532 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:22.818 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:22.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:22.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:22.928 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:23.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:23.010 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:23.011 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:23.068 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:23.068 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:23.068 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:23.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:23.534 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:23.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:23.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:23.644 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:23.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:23.720 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:23.720 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:23.778 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:23.778 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:23.778 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:23.778 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:24.070 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:24.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:24.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:24.180 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:24.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:24.259 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:24.259 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:24.316 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:24.317 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:24.317 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:24.317 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:24.779 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:24.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:24.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:24.889 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:24.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:24.966 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:24.966 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:25.023 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:25.024 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:25.024 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:25.024 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:25.318 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:25.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:25.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:25.429 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:25.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:25.514 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:25.514 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:25.571 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:25.571 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:25.572 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:25.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:26.025 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:26.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:26.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:26.137 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:26.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:26.216 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:26.216 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:26.273 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:26.273 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:26.273 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:26.273 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:26.573 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:26.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:26.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:26.684 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:26.768 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:26.768 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:26.768 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:26.825 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:26.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:26.826 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:26.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:27.275 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:27.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:27.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:27.384 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:27.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:27.471 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:27.471 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:27.529 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:27.529 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:27.529 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:27.530 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:27.827 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:27.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:27.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:27.938 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:28.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:28.014 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:28.014 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:28.071 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:28.072 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:28.072 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:28.072 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:28.531 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:28.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:28.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:28.642 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:28.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:28.716 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:28.716 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:28.772 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:28.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:28.773 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:28.773 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:29.074 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:29.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:29.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:29.138 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:29.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:29.220 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:29.220 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:29.276 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:29.276 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:29.276 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:29.277 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:29.774 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:29.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:29.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:29.884 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:29.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:29.971 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:29.971 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:30.028 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:30.029 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:30.029 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:30.029 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:30.278 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:30.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:30.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:30.342 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:30.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:30.420 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:30.420 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:30.478 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:30.478 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:30.478 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:30.478 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:31.030 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:31.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:31.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:31.093 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:31.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:31.180 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:31.181 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:31.238 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:31.238 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:31.238 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:31.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:31.479 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:31.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:31.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:31.542 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:31.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:31.615 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:31.615 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:31.672 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:31.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:31.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:31.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:32.239 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:32.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:32.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:32.303 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:32.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:32.377 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:32.377 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:32.434 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:32.434 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:32.434 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:32.434 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:32.675 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:32.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:32.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:32.737 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:32.820 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:32.820 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:32.820 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:32.878 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:32.879 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:32.879 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:32.879 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:33.435 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:33.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:33.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:33.534 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:33.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:33.604 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:33.604 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:33.662 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:33.663 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:33.663 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:33.663 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:33.881 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:33.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:33.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:33.991 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:34.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:34.067 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:34.067 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:34.124 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:34.125 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:34.125 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:34.125 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:34.664 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:34.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:34.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:34.775 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:34.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:34.847 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:34.847 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:34.904 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:34.904 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:34.905 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:34.905 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:35.127 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:35.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:35.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:35.238 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:35.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:35.317 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:35.317 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:35.374 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:35.374 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:35.375 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:35.375 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:35.905 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:35.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:35.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:35.996 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:36.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:36.072 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:36.072 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:36.131 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:36.131 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:36.131 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:36.132 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:36.376 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:36.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:36.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:36.486 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:36.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:36.572 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:36.572 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:36.628 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:36.628 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:36.628 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:36.628 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:37.133 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:37.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:37.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:37.243 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:37.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:37.327 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:37.327 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:37.384 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:37.384 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:37.384 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:37.384 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:37.630 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:37.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:37.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:37.741 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:37.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:37.821 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:37.821 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:37.878 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:37.878 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:37.879 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:37.879 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:38.385 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:38.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:38.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:38.448 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:38.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:38.523 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:38.523 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:38.580 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:38.581 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:38.581 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:38.581 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:38.880 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:38.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:38.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:38.984 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:39.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:39.069 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:39.070 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:39.126 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:39.127 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:39.127 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:39.127 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:39.582 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:39.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:39.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:39.682 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:39.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:39.760 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:39.760 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:39.818 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:39.818 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:39.818 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:39.818 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:40.128 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:40.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:40.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:40.237 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:40.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:40.323 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:40.323 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:40.380 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:40.381 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:40.381 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:40.381 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:40.819 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:40.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:40.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:40.930 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:41.011 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:41.011 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:41.011 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:41.069 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:41.069 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:41.069 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:41.069 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:41.382 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:41.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:41.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:41.493 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:41.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:41.572 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:41.573 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:41.631 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:41.631 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:41.631 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:41.631 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:42.070 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:42.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:42.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:42.180 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:42.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:42.258 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:42.258 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:42.316 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:42.316 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:42.316 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:42.316 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:42.633 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:42.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:42.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:42.703 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:42.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:42.785 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:42.785 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:42.841 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:42.841 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:42.842 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:42.842 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:43.317 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:43.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:43.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:43.379 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:43.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:43.470 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:43.470 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:43.527 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:43.527 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:43.527 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:43.527 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:43.842 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:43.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:43.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:43.948 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:44.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:44.030 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:44.031 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:44.088 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:44.088 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:44.088 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:44.088 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:44.529 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:44.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:44.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:44.594 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:44.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:44.668 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:44.668 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:44.726 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:44.726 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:44.726 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:44.726 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:45.089 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:45.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:45.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:45.202 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:45.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:45.275 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:45.276 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:45.332 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:45.333 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:45.333 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:45.333 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:45.727 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:45.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:45.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:45.837 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:45.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:45.913 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:45.913 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:45.970 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:45.970 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:45.970 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:45.970 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:46.335 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:46.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:46.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:46.446 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:46.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:46.535 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:46.535 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:46.592 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:46.592 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:46.592 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:46.592 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:46.971 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:46.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:46.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:47.037 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:47.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:47.114 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:47.114 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:47.171 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:47.171 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:47.171 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:47.171 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:47.593 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:47.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:47.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:47.702 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:47.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:47.788 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:47.788 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:47.845 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:47.845 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:47.845 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:47.846 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:48.172 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:48.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:48.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:48.236 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:48.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:48.319 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:48.319 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:48.379 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:48.379 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:48.379 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:48.379 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:48.847 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:48.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:48.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:48.958 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:49.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:49.038 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:49.038 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:49.095 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:49.095 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:49.095 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:49.095 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:49.380 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:49.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:49.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:49.490 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:49.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:49.569 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:49.570 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:49.627 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:49.627 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:49.627 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:49.627 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:50.097 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:50.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:50.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:50.209 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:50.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:50.288 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:50.289 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:50.346 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:50.346 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:50.347 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:50.347 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:50.628 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:50.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:50.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:50.738 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:50.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:50.814 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:50.814 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:50.872 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:50.872 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:50.872 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:50.872 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:51.348 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:51.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:51.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:51.457 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:51.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:51.536 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:51.536 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:51.595 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:51.596 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:51.596 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:51.596 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:51.874 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:51.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:51.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:51.983 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:52.061 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:52.061 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:52.061 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:52.117 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:52.118 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:52.118 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:52.118 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:52.597 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:52.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:52.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:52.709 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:52.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:52.789 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:52.790 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:52.846 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:52.847 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:52.847 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:52.847 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:53.120 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:53.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:53.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:53.183 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:53.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:53.259 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:53.259 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:53.316 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:53.316 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:53.316 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:53.316 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:53.849 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:53.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:53.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:53.962 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:54.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:54.040 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:54.040 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:54.098 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:54.099 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:54.099 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:54.099 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:54.317 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:54.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:54.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:54.382 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:54.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:54.465 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:54.465 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:54.522 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:54.522 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:54.522 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:54.522 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:55.101 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:55.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:55.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:55.204 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:55.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:55.286 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:55.287 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:55.344 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:55.344 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:55.344 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:55.345 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:55.523 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:55.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:55.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:55.633 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:55.715 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:55.715 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:55.715 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:55.772 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:55.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:55.772 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:55.772 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:56.346 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:56.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:56.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:56.457 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:56.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:56.545 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:56.545 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:56.602 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:56.602 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:56.602 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:56.602 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:56.774 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:56.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:56.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:56.883 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:56.964 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:56.964 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:56.964 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:57.022 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:57.022 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:57.022 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:57.022 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:57.604 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:57.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:57.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:57.713 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:57.798 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:57.798 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:57.798 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:57.856 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:57.856 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:57.856 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:57.856 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:58.024 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:58.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:58.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:58.133 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:58.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:58.209 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:58.209 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:58.266 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:58.267 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:58.267 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:58.267 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:58.857 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:13:58.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:58.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:58.968 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:13:59.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:13:59.040 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:59.040 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:13:59.098 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:59.098 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:59.098 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:59.098 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:13:59.268 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:13:59.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:59.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:13:59.378 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:13:59.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:13:59.466 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:13:59.466 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:13:59.524 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:13:59.524 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:13:59.524 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:13:59.524 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:00.100 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:00.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:00.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:00.211 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:00.296 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:00.296 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:00.296 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:00.352 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:00.352 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:00.352 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:00.352 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:00.526 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:00.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:00.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:00.590 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:00.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:00.666 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:00.666 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:00.723 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:00.723 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:00.723 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:00.723 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:01.353 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:01.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:01.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:01.415 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:01.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:01.491 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:01.491 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:01.547 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:01.547 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:01.547 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:01.547 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:01.725 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:01.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:01.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:01.787 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:01.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:01.873 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:01.873 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:01.930 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:01.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:01.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:01.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:02.548 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:02.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:02.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:02.615 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:02.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:02.702 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:02.702 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:02.758 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:02.758 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:02.758 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:02.758 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:02.931 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:02.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:02.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:02.998 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:03.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:03.076 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:03.076 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:03.134 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:03.135 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:03.135 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:03.135 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:03.759 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:03.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:03.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:03.827 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:03.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:03.912 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:03.912 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:03.968 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:03.969 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:03.969 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:03.969 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:04.136 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:04.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:04.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:04.230 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:04.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:04.312 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:04.312 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:04.369 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:04.369 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:04.369 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:04.370 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:04.971 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:04.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:04.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:05.081 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:05.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:05.168 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:05.168 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:05.225 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:05.225 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:05.226 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:05.226 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:05.371 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:05.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:05.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:05.481 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:05.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:05.567 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:05.567 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:05.623 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:05.624 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:05.624 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:05.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:06.227 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:06.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:06.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:06.336 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:06.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:06.420 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:06.420 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:06.476 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:06.477 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:06.477 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:06.477 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:06.625 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:06.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:06.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:06.735 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:06.812 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:06.812 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:06.812 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:06.869 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:06.870 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:06.870 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:06.870 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:07.478 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:07.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:07.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:07.542 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:07.617 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:07.617 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:07.617 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:07.674 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:07.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:07.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:07.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:07.871 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:07.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:07.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:07.939 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:08.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:08.027 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:08.028 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:08.085 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:08.085 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:08.085 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:08.085 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:08.675 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:08.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:08.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:08.742 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:08.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:08.821 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:08.822 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:08.878 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:08.878 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:08.878 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:08.878 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:09.086 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:09.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:09.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:09.153 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:09.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:09.240 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:09.240 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:09.297 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:09.297 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:09.297 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:09.297 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:09.880 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:09.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:09.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:09.989 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:10.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:10.062 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:10.062 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:10.120 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:10.120 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:10.120 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:10.120 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:10.298 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:10.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:10.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:10.408 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:10.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:10.484 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:10.484 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:10.540 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:10.541 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:10.541 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:10.541 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:11.122 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:11.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:11.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:11.233 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:11.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:11.314 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:11.314 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:11.372 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:11.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:11.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:11.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:11.542 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:11.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:11.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:11.652 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:11.739 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:11.739 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:11.739 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:11.797 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:11.797 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:11.797 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:11.797 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:12.373 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:12.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:12.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:12.450 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:12.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:12.532 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:12.533 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:12.590 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:12.590 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:12.590 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:12.590 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:12.798 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:12.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:12.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:12.904 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:12.988 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:12.988 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:12.988 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:13.044 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:13.044 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:13.044 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:13.044 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:13.591 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:13.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:13.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:13.701 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:13.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:13.787 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:13.788 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:13.845 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:13.845 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:13.845 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:13.845 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:14.045 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:14.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:14.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:14.154 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:14.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:14.231 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:14.231 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:14.289 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:14.289 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:14.289 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:14.289 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:14.847 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:14.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:14.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:14.956 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:15.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:15.036 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:15.036 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:15.093 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:15.093 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:15.094 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:15.094 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:15.290 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:15.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:15.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:15.367 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:15.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:15.443 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:15.443 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:15.500 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:15.500 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:15.500 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:15.500 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:16.095 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:16.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:16.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:16.205 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:16.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:16.281 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:16.281 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:16.339 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:16.339 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:16.339 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:16.339 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:16.501 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:16.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:16.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:16.611 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:16.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:16.688 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:16.688 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:16.744 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:16.744 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:16.745 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:16.745 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:17.341 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:17.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:17.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:17.450 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:17.533 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:17.534 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:17.534 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:17.591 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:17.591 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:17.592 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:17.592 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:17.746 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:17.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:17.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:17.813 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:17.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:17.891 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:17.891 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:17.948 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:17.948 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:17.948 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:17.948 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:18.593 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:18.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:18.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:18.703 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:18.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:18.785 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:18.785 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:18.842 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:18.842 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:18.843 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:18.843 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:18.949 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:18.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:18.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:19.058 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:19.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:19.140 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:19.140 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:19.197 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:19.198 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:19.198 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:19.198 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:19.844 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:19.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:19.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:19.907 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:19.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:19.982 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:19.982 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:20.039 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:20.040 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:20.040 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:20.040 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:20.200 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:20.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:20.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:20.309 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:20.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:20.385 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:20.385 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:20.442 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:20.442 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:20.442 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:20.442 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:21.041 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:21.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:21.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:21.119 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:21.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:21.193 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:21.193 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:21.251 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:21.251 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:21.251 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:21.252 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:21.444 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:21.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:21.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:21.510 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:21.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:21.583 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:21.583 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:21.640 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:21.640 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:21.640 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:21.640 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:22.253 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:22.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:22.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:22.331 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:22.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:22.413 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:22.413 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:22.469 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:22.470 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:22.470 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:22.470 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:22.641 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:22.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:22.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:22.752 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:22.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:22.837 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:22.837 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:22.893 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:22.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:22.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:22.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:23.471 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:23.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:23.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:23.582 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:23.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:23.670 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:23.670 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:23.726 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:23.726 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:23.726 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:23.726 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:23.894 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:23.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:23.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:23.957 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:24.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:24.031 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:24.031 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:24.087 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:24.087 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:24.087 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:24.087 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:24.727 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:24.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:24.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:24.838 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:24.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:24.917 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:24.917 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:24.974 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:24.974 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:24.974 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:24.974 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:25.089 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:25.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:25.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:25.198 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:25.282 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:25.282 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:25.282 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:25.340 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:25.340 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:25.340 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:25.340 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:25.975 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:25.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:25.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:26.040 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:26.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:26.120 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:26.120 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:26.177 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:26.177 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:26.177 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:26.177 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:26.341 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:26.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:26.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:26.449 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:26.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:26.539 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:26.539 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:26.597 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:26.597 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:26.597 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:26.597 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:27.178 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:27.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:27.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:27.288 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:27.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:27.359 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:27.359 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:27.416 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:27.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:27.416 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:27.417 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:27.598 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:27.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:27.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:27.708 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:27.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:27.794 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:27.794 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:27.852 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:27.852 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:27.853 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:27.853 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:28.418 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:28.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:28.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:28.530 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:28.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:28.625 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:28.625 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:28.682 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:28.682 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:28.682 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:28.682 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:28.854 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:28.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:28.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:28.965 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:29.047 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:29.047 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:29.047 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:29.104 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:29.104 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:29.104 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:29.104 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:29.683 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:29.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:29.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:29.747 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:29.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:29.821 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:29.821 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:29.879 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:29.880 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:29.880 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:29.880 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:30.106 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:30.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:30.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:30.186 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:30.276 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:30.276 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:30.276 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:30.335 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:30.335 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:30.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:30.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:30.882 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:30.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:30.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:30.992 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:31.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:31.065 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:31.065 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:31.123 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:31.123 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:31.123 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:31.124 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:31.336 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:31.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:31.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:31.447 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:31.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:31.535 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:31.535 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:31.593 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:31.593 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:31.594 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:31.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:32.125 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:32.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:32.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:32.235 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:32.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:32.314 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:32.314 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:32.371 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:32.371 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:32.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:32.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:32.595 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:32.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:32.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:32.705 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:32.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:32.796 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:32.796 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:32.854 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:32.854 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:32.855 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:32.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:33.373 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:33.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:33.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:33.483 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:33.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:33.564 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:33.564 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:33.621 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:33.621 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:33.622 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:33.622 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:33.856 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:33.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:33.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:33.967 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:34.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:34.053 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:34.053 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:34.110 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:34.110 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:34.111 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:34.111 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:34.623 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:34.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:34.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:34.732 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:34.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:34.815 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:34.815 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:34.875 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:34.875 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:34.875 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:34.875 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:35.112 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:35.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:35.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:35.220 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:35.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:35.295 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:35.295 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:35.352 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:35.352 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:35.352 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:35.352 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:35.877 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:35.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:35.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:35.989 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:36.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:36.073 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:36.073 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:36.130 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:36.131 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:36.131 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:36.131 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:36.354 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:36.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:36.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:36.463 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:36.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:36.548 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:36.548 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:36.605 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:36.605 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:36.605 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:36.606 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:37.132 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:37.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:37.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:37.243 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:37.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:37.316 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:37.316 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:37.374 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:37.374 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:37.375 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:37.375 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:37.606 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:37.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:37.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:37.716 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:37.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:37.792 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:37.792 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:37.849 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:37.850 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:37.850 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:37.850 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:38.376 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:38.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:38.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:38.448 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:38.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:38.531 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:38.531 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:38.589 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:38.589 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:38.589 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:38.589 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:38.851 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:38.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:38.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:38.913 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:38.996 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:38.996 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:38.996 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:39.054 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:39.054 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:39.054 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:39.054 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:39.590 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:39.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:39.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:39.701 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:39.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:39.788 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:39.788 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:39.845 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:39.845 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:39.845 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:39.845 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:40.056 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:40.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:40.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:40.165 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:40.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:40.252 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:40.252 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:40.310 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:40.310 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:40.310 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:40.310 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:40.846 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:40.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:40.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:40.957 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:41.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:41.045 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:41.045 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:41.102 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:41.103 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:41.103 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:41.103 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:41.312 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:41.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:41.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:41.422 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:41.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:41.510 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:41.510 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:41.568 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:41.568 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:41.569 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:41.569 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:42.104 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:42.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:42.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:42.217 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:42.294 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:42.294 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:42.294 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:42.351 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:42.351 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:42.351 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:42.352 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:42.570 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:42.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:42.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:42.680 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:42.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:42.762 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:42.762 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:42.820 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:42.820 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:42.820 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:42.820 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:43.353 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:43.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:43.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:43.463 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:43.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:43.542 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:43.543 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:43.599 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:43.600 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:43.600 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:43.600 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:43.822 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:43.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:43.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:43.931 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:44.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:44.018 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:44.019 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:44.075 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:44.076 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:44.076 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:44.076 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:44.602 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:44.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:44.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:44.713 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:44.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:44.796 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:44.796 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:44.853 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:44.853 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:44.853 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:44.853 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:45.077 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:45.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:45.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:45.188 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:45.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:45.263 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:45.263 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:45.320 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:45.321 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:45.321 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:45.321 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:45.854 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:45.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:45.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:45.965 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:46.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:46.052 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:46.052 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:46.109 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:46.109 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.109 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:46.110 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:46.323 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:46.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:46.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:46.397 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:46.486 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:46.486 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:46.486 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:46.543 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:46.543 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:46.543 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:46.543 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:47.111 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:47.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:47.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:47.192 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:47.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:47.273 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:47.273 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:47.330 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:47.330 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:47.330 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:47.330 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:47.544 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:47.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:47.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:47.605 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:47.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:47.682 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:47.682 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:47.739 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:47.739 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:47.740 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:47.740 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:48.331 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:48.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:48.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:48.442 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:48.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:48.519 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:48.519 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:48.576 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:48.577 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:48.577 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:48.577 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:48.741 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:48.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:48.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:48.850 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:48.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:48.933 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:48.933 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:48.990 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:48.990 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:48.990 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:48.990 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:49.578 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:49.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:49.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:49.688 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:49.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:49.773 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:49.773 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:49.831 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:49.831 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:49.831 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:49.832 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:49.992 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:49.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:49.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:50.102 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:50.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:50.180 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:50.180 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:50.238 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:50.238 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:50.238 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:50.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:50.833 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:50.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:50.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:50.943 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:51.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:51.020 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:51.020 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:51.077 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:51.077 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:51.077 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:51.078 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:51.240 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:51.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:51.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:51.349 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:51.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:51.421 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:51.421 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:51.478 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:51.478 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:51.478 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:51.478 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:52.079 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:52.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:52.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:52.189 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:52.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:52.272 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:52.272 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:52.329 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:52.329 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:52.329 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:52.330 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:52.480 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:52.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:52.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:52.590 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:52.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:52.669 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:52.670 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:52.727 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:52.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:52.728 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:52.728 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:53.331 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:53.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:53.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:53.442 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:53.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:53.521 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:53.521 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:53.580 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:53.580 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:53.581 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:53.581 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:53.729 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:53.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:53.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:53.839 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:53.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:53.922 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:53.922 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:53.980 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:53.980 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:53.980 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:53.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:54.582 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:54.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:54.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:54.693 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:54.768 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:54.768 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:54.768 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:54.825 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:54.825 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:54.825 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:54.825 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:54.982 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:54.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:54.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:55.091 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:55.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:55.181 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:55.181 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:55.238 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:55.238 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:55.238 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:55.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:55.827 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:55.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:55.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:55.937 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:56.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:56.017 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:56.017 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:56.074 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:56.074 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:56.074 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:56.074 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:56.240 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:56.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:56.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:56.349 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:56.425 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:56.425 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:56.425 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:56.482 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:56.482 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:56.482 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:56.482 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:57.075 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:57.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:57.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:57.143 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:57.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:57.231 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:57.231 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:57.287 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:57.288 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:57.288 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:57.288 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:57.484 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:57.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:57.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:57.594 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:57.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:57.685 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:57.686 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:57.743 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:57.743 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:57.744 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:57.744 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:58.289 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:58.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:58.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:58.402 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:58.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:58.482 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:58.482 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:58.539 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:58.539 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:58.539 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:58.539 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:58.745 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:58.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:58.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:58.854 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:14:58.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:58.930 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:58.930 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:14:58.986 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:58.987 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:58.987 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:58.987 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:59.540 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:14:59.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:59.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:14:59.650 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:14:59.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:14:59.729 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:14:59.730 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:14:59.787 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:14:59.787 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:14:59.787 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:14:59.787 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:14:59.988 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:14:59.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:14:59.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:00.097 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:15:00.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:00.173 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:00.173 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:15:00.230 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:00.230 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:00.230 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:00.230 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:00.789 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:00.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:00.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:00.852 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:15:00.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:00.929 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:00.929 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:15:00.987 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:00.987 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:00.988 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:00.988 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:01.231 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:01.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:01.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:01.341 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:15:01.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:01.423 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:01.423 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:15:01.480 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:01.481 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:01.481 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:01.481 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:01.989 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:01.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:01.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:02.100 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:15:02.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:02.175 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:02.175 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:15:02.232 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:02.232 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:02.232 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:02.232 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:02.482 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:02.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:02.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:02.591 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:15:02.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:02.670 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:02.670 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:15:02.727 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:02.727 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:02.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:02.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:03.234 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:03.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:03.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:03.345 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:15:03.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:03.420 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:03.420 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:15:03.479 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:03.479 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:03.479 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:03.479 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:03.728 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:03.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:03.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:03.839 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:15:03.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:03.926 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:03.926 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:15:03.983 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:03.983 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:03.984 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:03.984 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:04.481 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:04.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:04.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:04.592 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:15:04.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:04.673 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:04.673 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:15:04.730 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:04.730 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:04.730 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:04.731 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:04.985 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:04.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:04.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:05.096 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:15:05.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:05.172 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:05.172 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:15:05.230 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:05.230 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:05.230 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:05.230 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:05.732 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:05.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:05.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:05.845 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:15:05.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:05.928 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:05.929 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:15:05.987 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:05.987 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:05.987 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:05.987 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:06.231 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:06.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:06.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:06.341 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:15:06.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:06.430 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:06.430 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:15:06.487 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:06.487 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:06.487 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:06.487 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:06.988 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:06.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:06.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:07.093 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:15:07.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:07.169 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:07.169 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:15:07.225 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:07.226 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:07.226 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:07.226 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:07.488 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:07.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:07.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:07.598 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:15:07.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:07.671 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:07.671 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:15:07.729 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:07.730 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:07.730 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:07.730 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:08.227 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:08.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:08.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:08.337 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:15:08.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:08.411 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:08.411 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:15:08.470 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:08.471 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:08.471 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:08.471 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:08.732 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:08.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:08.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:08.842 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:15:08.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:08.916 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:08.916 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:15:08.974 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:08.974 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:08.974 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:08.974 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:09.472 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:09.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:09.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:09.537 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:15:09.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:09.613 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:09.613 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:15:09.669 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:09.669 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:09.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:09.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:09.975 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:09.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:09.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:10.087 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:15:10.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:10.163 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:10.164 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:15:10.221 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:10.221 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:10.221 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:10.222 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:10.671 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:10.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:10.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:10.783 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:15:10.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:10.865 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:10.866 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:15:10.923 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:10.923 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:10.923 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:10.923 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:11.223 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:11.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:11.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:11.333 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:15:11.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:11.418 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:11.418 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:15:11.476 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:11.476 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:11.476 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:11.476 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:11.924 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:11.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:11.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:12.035 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:15:12.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:12.120 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:12.120 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:15:12.177 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:12.177 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:12.177 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:12.177 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:12.478 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:12.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:12.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:12.591 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:15:12.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:12.668 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:12.668 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:15:12.725 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:12.725 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:12.725 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:12.725 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:13.179 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:13.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:13.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:13.292 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:15:13.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:13.370 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:13.370 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:15:13.428 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:13.428 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:13.428 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:13.428 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:13.727 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:15:13.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:13.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:13.836 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-12T22:15:13.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-12T22:15:13.908 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:13.908 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-12T22:15:13.967 INFO:teuthology.orchestra.run.trial070.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:13.968 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:13.968 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:13.968 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:14.430 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:15:14.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:14.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:15:14.533 DEBUG:teuthology.orchestra.run.trial178:> true 2026-02-12T22:15:14.614 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial178.front.sepia.ceph.com' 2026-02-12T22:15:14.614 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:15:14.614 DEBUG:teuthology.orchestra.run.trial178:> uname -r 2026-02-12T22:15:14.672 INFO:teuthology.orchestra.run.trial178.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:15:14.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:15:14.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:15:14.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:14.674 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:15:14.675 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:15:14.688 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:15:14.722 INFO:teuthology.run:Summary data: description: fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_pjd} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:15:14.722 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:15:14.839 INFO:teuthology.run:FAIL