2026-02-12T22:23:53.712 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:23:53.732 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:23:53.812 INFO:teuthology.run:Config: -mds_creation_failure: - workunit: clients: all: - fs/misc/trivial_sync.sh archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47199 branch: wip-pdonnell-testing-20260210.171210 description: fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds_creation_retry} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47199' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds use global snaprealm seq for subvol: false mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial048.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPe7RGfHTgbH5tcsY9GMGw9vurTxwzcC8XAnhdOEfG1Zmyyv3Q1SOgECcpKgZ/m2y44SQcm78vaIdVz/n51V++4= trial131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGunkbJzqnWpwHf4QKXQh5ItfB3ixV8cGrWYWnM3tMeUV6ANB+50fpcVj5QHgMBKS2AGuXRgBmVgeoNQbXLlcpo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - ceph-fuse: null teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:23:53.812 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:23:53.812 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:23:53.812 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:23:53.814 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:23:53.814 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:23:53.814 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:23:53.814 INFO:teuthology.packaging:ref: None 2026-02-12T22:23:53.814 INFO:teuthology.packaging:tag: None 2026-02-12T22:23:53.814 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:23:53.814 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:23:53.814 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:23:53.937 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:23:53.938 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:23:53.949 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:23:53.949 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:23:53.962 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:23:53.976 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:23:53.988 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:23:54.062 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial048.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47199', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:20:30.911073', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPe7RGfHTgbH5tcsY9GMGw9vurTxwzcC8XAnhdOEfG1Zmyyv3Q1SOgECcpKgZ/m2y44SQcm78vaIdVz/n51V++4='} 2026-02-12T22:23:54.118 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial131.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47199', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:20:30.910407', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGunkbJzqnWpwHf4QKXQh5ItfB3ixV8cGrWYWnM3tMeUV6ANB+50fpcVj5QHgMBKS2AGuXRgBmVgeoNQbXLlcpo='} 2026-02-12T22:23:54.118 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:23:54.128 INFO:teuthology.task.internal:roles: ubuntu@trial048.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2026-02-12T22:23:54.128 INFO:teuthology.task.internal:roles: ubuntu@trial131.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2026-02-12T22:23:54.129 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:23:54.261 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7cd0c5ae7f60>, signals=[15]) 2026-02-12T22:23:54.261 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:23:54.271 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:23:54.271 DEBUG:teuthology.task.internal:connecting to ubuntu@trial048.front.sepia.ceph.com 2026-02-12T22:23:54.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:54.331 DEBUG:teuthology.task.internal:connecting to ubuntu@trial131.front.sepia.ceph.com 2026-02-12T22:23:54.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:23:54.389 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:23:54.400 DEBUG:teuthology.orchestra.run.trial048:> uname -m 2026-02-12T22:23:54.416 INFO:teuthology.orchestra.run.trial048.stdout:x86_64 2026-02-12T22:23:54.417 DEBUG:teuthology.orchestra.run.trial048:> cat /etc/os-release 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:NAME="Rocky Linux" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:ID="rocky" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:VERSION_ID="10.1" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:ANSI_COLOR="0;32" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:VENDOR_NAME="RESF" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:23:54.475 INFO:teuthology.orchestra.run.trial048.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:23:54.476 INFO:teuthology.lock.ops:Updating trial048.front.sepia.ceph.com on lock server 2026-02-12T22:23:54.546 DEBUG:teuthology.orchestra.run.trial131:> uname -m 2026-02-12T22:23:54.563 INFO:teuthology.orchestra.run.trial131.stdout:x86_64 2026-02-12T22:23:54.563 DEBUG:teuthology.orchestra.run.trial131:> cat /etc/os-release 2026-02-12T22:23:54.619 INFO:teuthology.orchestra.run.trial131.stdout:NAME="Rocky Linux" 2026-02-12T22:23:54.619 INFO:teuthology.orchestra.run.trial131.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:ID="rocky" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:VERSION_ID="10.1" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:ANSI_COLOR="0;32" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:VENDOR_NAME="RESF" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:23:54.620 INFO:teuthology.orchestra.run.trial131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:23:54.620 INFO:teuthology.lock.ops:Updating trial131.front.sepia.ceph.com on lock server 2026-02-12T22:23:54.696 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:23:54.708 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:23:54.720 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:23:54.720 DEBUG:teuthology.orchestra.run.trial048:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:23:54.722 DEBUG:teuthology.orchestra.run.trial131:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:23:54.738 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:23:54.749 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:23:54.749 DEBUG:teuthology.orchestra.run.trial048:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:23:54.778 DEBUG:teuthology.orchestra.run.trial131:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:23:54.793 INFO:teuthology.orchestra.run.trial048.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:23:54.796 INFO:teuthology.orchestra.run.trial131.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:23:54.796 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:23:54.951 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:23:54.970 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:23:54.970 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:23:54.970 DEBUG:teuthology.orchestra.run.trial048:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:23:54.971 DEBUG:teuthology.orchestra.run.trial131:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:23:54.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:23:54.987 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:23:54.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:23:54.987 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:23:55.043 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:55.043 INFO:teuthology.task.kernel:Running kernel on trial048: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:55.043 DEBUG:teuthology.orchestra.run.trial048:> sudo yum install -y kernel 2026-02-12T22:23:55.044 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:55.044 INFO:teuthology.task.kernel:Running kernel on trial131: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:23:55.044 DEBUG:teuthology.orchestra.run.trial131:> sudo yum install -y kernel 2026-02-12T22:23:55.556 INFO:teuthology.orchestra.run.trial048.stdout:Rocky Linux 10 - AppStream 20 MB/s | 2.2 MB 00:00 2026-02-12T22:23:55.558 INFO:teuthology.orchestra.run.trial131.stdout:Rocky Linux 10 - AppStream 19 MB/s | 2.2 MB 00:00 2026-02-12T22:23:55.891 INFO:teuthology.orchestra.run.trial131.stdout:Rocky Linux 10 - BaseOS 53 MB/s | 11 MB 00:00 2026-02-12T22:23:55.893 INFO:teuthology.orchestra.run.trial048.stdout:Rocky Linux 10 - BaseOS 52 MB/s | 11 MB 00:00 2026-02-12T22:23:56.373 INFO:teuthology.orchestra.run.trial048.stdout:Rocky Linux 10 - CRB 6.7 MB/s | 507 kB 00:00 2026-02-12T22:23:56.387 INFO:teuthology.orchestra.run.trial131.stdout:Rocky Linux 10 - CRB 6.4 MB/s | 507 kB 00:00 2026-02-12T22:23:56.741 INFO:teuthology.orchestra.run.trial048.stdout:Extra Packages for Enterprise Linux 19 MB/s | 6.2 MB 00:00 2026-02-12T22:23:57.105 INFO:teuthology.orchestra.run.trial131.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 6.2 MB 00:00 2026-02-12T22:23:57.394 INFO:teuthology.orchestra.run.trial048.stdout:lab-extras 317 kB/s | 3.7 kB 00:00 2026-02-12T22:23:57.771 INFO:teuthology.orchestra.run.trial131.stdout:lab-extras 297 kB/s | 3.7 kB 00:00 2026-02-12T22:23:57.800 INFO:teuthology.orchestra.run.trial048.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:23:57.812 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T22:23:57.813 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T22:23:57.813 INFO:teuthology.orchestra.run.trial048.stdout: Package Arch Version Repo Size 2026-02-12T22:23:57.813 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T22:23:57.813 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T22:23:57.813 INFO:teuthology.orchestra.run.trial048.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:23:57.813 INFO:teuthology.orchestra.run.trial048.stdout:Installing dependencies: 2026-02-12T22:23:57.813 INFO:teuthology.orchestra.run.trial048.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:23:57.813 INFO:teuthology.orchestra.run.trial048.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:23:57.814 INFO:teuthology.orchestra.run.trial048.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:23:57.814 INFO:teuthology.orchestra.run.trial048.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:23:57.814 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T22:23:57.814 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T22:23:57.814 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T22:23:57.814 INFO:teuthology.orchestra.run.trial048.stdout:Install 5 Packages 2026-02-12T22:23:57.814 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T22:23:57.814 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 93 M 2026-02-12T22:23:57.814 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 135 M 2026-02-12T22:23:57.814 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T22:23:57.869 INFO:teuthology.orchestra.run.trial048.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 25 MB/s | 1.4 MB 00:00 2026-02-12T22:23:58.184 INFO:teuthology.orchestra.run.trial131.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:23:58.196 INFO:teuthology.orchestra.run.trial131.stdout:Dependencies resolved. 2026-02-12T22:23:58.197 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T22:23:58.197 INFO:teuthology.orchestra.run.trial131.stdout: Package Arch Version Repo Size 2026-02-12T22:23:58.197 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T22:23:58.197 INFO:teuthology.orchestra.run.trial131.stdout:Installing: 2026-02-12T22:23:58.197 INFO:teuthology.orchestra.run.trial131.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:23:58.197 INFO:teuthology.orchestra.run.trial131.stdout:Installing dependencies: 2026-02-12T22:23:58.197 INFO:teuthology.orchestra.run.trial131.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:23:58.197 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:23:58.198 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:23:58.198 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:23:58.198 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T22:23:58.198 INFO:teuthology.orchestra.run.trial131.stdout:Transaction Summary 2026-02-12T22:23:58.198 INFO:teuthology.orchestra.run.trial131.stdout:================================================================================ 2026-02-12T22:23:58.198 INFO:teuthology.orchestra.run.trial131.stdout:Install 5 Packages 2026-02-12T22:23:58.198 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T22:23:58.198 INFO:teuthology.orchestra.run.trial131.stdout:Total download size: 93 M 2026-02-12T22:23:58.198 INFO:teuthology.orchestra.run.trial131.stdout:Installed size: 135 M 2026-02-12T22:23:58.198 INFO:teuthology.orchestra.run.trial131.stdout:Downloading Packages: 2026-02-12T22:23:58.206 INFO:teuthology.orchestra.run.trial048.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 47 MB/s | 18 MB 00:00 2026-02-12T22:23:58.252 INFO:teuthology.orchestra.run.trial131.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 25 MB/s | 1.4 MB 00:00 2026-02-12T22:23:58.256 INFO:teuthology.orchestra.run.trial048.stdout:(3/5): kernel-modules-core-6.12.0-124.31.1.el10 76 MB/s | 30 MB 00:00 2026-02-12T22:23:58.291 INFO:teuthology.orchestra.run.trial048.stdout:(4/5): kernel-modules-extra-6.12.0-124.31.1.el1 33 MB/s | 2.8 MB 00:00 2026-02-12T22:23:58.397 INFO:teuthology.orchestra.run.trial048.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 70 MB/s | 41 MB 00:00 2026-02-12T22:23:58.398 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:23:58.398 INFO:teuthology.orchestra.run.trial048.stdout:Total 158 MB/s | 93 MB 00:00 2026-02-12T22:23:58.399 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T22:23:58.471 INFO:teuthology.orchestra.run.trial131.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 67 MB/s | 18 MB 00:00 2026-02-12T22:23:58.524 INFO:teuthology.orchestra.run.trial131.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 53 MB/s | 2.8 MB 00:00 2026-02-12T22:23:58.545 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T22:23:58.546 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T22:23:58.630 INFO:teuthology.orchestra.run.trial131.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 78 MB/s | 30 MB 00:00 2026-02-12T22:23:58.899 INFO:teuthology.orchestra.run.trial131.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 58 MB/s | 41 MB 00:00 2026-02-12T22:23:58.900 INFO:teuthology.orchestra.run.trial131.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:23:58.900 INFO:teuthology.orchestra.run.trial131.stdout:Total 132 MB/s | 93 MB 00:00 2026-02-12T22:23:58.900 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction check 2026-02-12T22:23:58.947 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T22:23:58.947 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T22:23:59.045 INFO:teuthology.orchestra.run.trial131.stdout:Transaction check succeeded. 2026-02-12T22:23:59.045 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction test 2026-02-12T22:23:59.446 INFO:teuthology.orchestra.run.trial131.stdout:Transaction test succeeded. 2026-02-12T22:23:59.446 INFO:teuthology.orchestra.run.trial131.stdout:Running transaction 2026-02-12T22:23:59.640 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T22:23:59.842 INFO:teuthology.orchestra.run.trial048.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:23:59.863 INFO:teuthology.orchestra.run.trial048.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:24:00.138 INFO:teuthology.orchestra.run.trial131.stdout: Preparing : 1/1 2026-02-12T22:24:00.339 INFO:teuthology.orchestra.run.trial131.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:24:00.360 INFO:teuthology.orchestra.run.trial131.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:24:01.124 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:24:01.153 INFO:teuthology.orchestra.run.trial048.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:24:01.619 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:24:01.647 INFO:teuthology.orchestra.run.trial131.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:24:02.996 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:24:03.002 INFO:teuthology.orchestra.run.trial048.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:24:03.491 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:24:03.497 INFO:teuthology.orchestra.run.trial131.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:24:04.866 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:24:04.876 INFO:teuthology.orchestra.run.trial048.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:24:05.353 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:24:05.363 INFO:teuthology.orchestra.run.trial131.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:24:06.739 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:24:07.227 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:24:40.615 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:24:40.638 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:24:40.872 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:24:40.872 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T22:24:40.872 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T22:24:40.872 INFO:teuthology.orchestra.run.trial048.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:40.872 INFO:teuthology.orchestra.run.trial048.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:40.872 INFO:teuthology.orchestra.run.trial048.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:40.872 INFO:teuthology.orchestra.run.trial048.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:40.873 INFO:teuthology.orchestra.run.trial048.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:40.873 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T22:24:40.873 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T22:24:40.880 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:24:40.901 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:24:40.940 DEBUG:teuthology.orchestra.run.trial048:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:24:40.974 INFO:teuthology.orchestra.run.trial048.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:40.975 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:40.975 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:40.975 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:24:40.975 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:24:40.975 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:24:40.976 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial048.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:24:40.976 DEBUG:teuthology.orchestra.run.trial048:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:24:41.048 INFO:teuthology.orchestra.run.trial048.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.049 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.049 DEBUG:teuthology.orchestra.run.trial048:> sudo rpm -qi grub2-tools 2026-02-12T22:24:41.121 INFO:teuthology.orchestra.run.trial048.stdout:Name : grub2-tools 2026-02-12T22:24:41.122 INFO:teuthology.orchestra.run.trial048.stdout:Epoch : 1 2026-02-12T22:24:41.122 INFO:teuthology.orchestra.run.trial048.stdout:Version : 2.12 2026-02-12T22:24:41.122 INFO:teuthology.orchestra.run.trial048.stdout:Release : 29.el10_1 2026-02-12T22:24:41.122 INFO:teuthology.orchestra.run.trial048.stdout:Architecture: x86_64 2026-02-12T22:24:41.122 INFO:teuthology.orchestra.run.trial048.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:24:41.122 INFO:teuthology.orchestra.run.trial048.stdout:Group : Unspecified 2026-02-12T22:24:41.122 INFO:teuthology.orchestra.run.trial048.stdout:Size : 7963769 2026-02-12T22:24:41.122 INFO:teuthology.orchestra.run.trial048.stdout:License : GPL-3.0-or-later 2026-02-12T22:24:41.122 INFO:teuthology.orchestra.run.trial048.stdout:Signature : 2026-02-12T22:24:41.123 INFO:teuthology.orchestra.run.trial048.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:24:41.123 INFO:teuthology.orchestra.run.trial048.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:24:41.123 INFO:teuthology.orchestra.run.trial048.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:24:41.123 INFO:teuthology.orchestra.run.trial048.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:24:41.123 INFO:teuthology.orchestra.run.trial048.stdout:Packager : Release Engineering 2026-02-12T22:24:41.123 INFO:teuthology.orchestra.run.trial048.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:24:41.123 INFO:teuthology.orchestra.run.trial048.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:24:41.123 INFO:teuthology.orchestra.run.trial048.stdout:Summary : Support tools for GRUB. 2026-02-12T22:24:41.123 INFO:teuthology.orchestra.run.trial048.stdout:Description : 2026-02-12T22:24:41.123 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T22:24:41.123 INFO:teuthology.orchestra.run.trial048.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:24:41.123 INFO:teuthology.orchestra.run.trial048.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:24:41.124 INFO:teuthology.orchestra.run.trial048.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:24:41.124 INFO:teuthology.orchestra.run.trial048.stdout:hardware devices. 2026-02-12T22:24:41.124 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T22:24:41.124 INFO:teuthology.orchestra.run.trial048.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:24:41.125 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:24:41.125 INFO:teuthology.task.kernel:Updating grub on trial048 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.125 DEBUG:teuthology.orchestra.run.trial048:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:24:41.134 INFO:teuthology.orchestra.run.trial131.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:24:41.134 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T22:24:41.134 INFO:teuthology.orchestra.run.trial131.stdout:Installed: 2026-02-12T22:24:41.134 INFO:teuthology.orchestra.run.trial131.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.134 INFO:teuthology.orchestra.run.trial131.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.134 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.134 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.134 INFO:teuthology.orchestra.run.trial131.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.134 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T22:24:41.134 INFO:teuthology.orchestra.run.trial131.stdout:Complete! 2026-02-12T22:24:41.192 INFO:teuthology.orchestra.run.trial048.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:24:41.193 DEBUG:teuthology.orchestra.run.trial048:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:24:41.199 DEBUG:teuthology.orchestra.run.trial131:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:24:41.233 INFO:teuthology.orchestra.run.trial131.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.234 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.234 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.234 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:24:41.234 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:24:41.234 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:24:41.234 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial131.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:24:41.235 DEBUG:teuthology.orchestra.run.trial131:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:24:41.261 INFO:teuthology.orchestra.run.trial048.stdout:/sbin/grubby 2026-02-12T22:24:41.262 INFO:teuthology.orchestra.run.trial048.stdout:yes 2026-02-12T22:24:41.263 DEBUG:teuthology.orchestra.run.trial048:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:24:41.306 INFO:teuthology.orchestra.run.trial131.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.307 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.307 DEBUG:teuthology.orchestra.run.trial131:> sudo rpm -qi grub2-tools 2026-02-12T22:24:41.329 INFO:teuthology.orchestra.run.trial048.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:24:41.330 DEBUG:teuthology.orchestra.run.trial048:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.379 INFO:teuthology.orchestra.run.trial131.stdout:Name : grub2-tools 2026-02-12T22:24:41.379 INFO:teuthology.orchestra.run.trial131.stdout:Epoch : 1 2026-02-12T22:24:41.379 INFO:teuthology.orchestra.run.trial131.stdout:Version : 2.12 2026-02-12T22:24:41.379 INFO:teuthology.orchestra.run.trial131.stdout:Release : 29.el10_1 2026-02-12T22:24:41.379 INFO:teuthology.orchestra.run.trial131.stdout:Architecture: x86_64 2026-02-12T22:24:41.380 INFO:teuthology.orchestra.run.trial131.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:24:41.380 INFO:teuthology.orchestra.run.trial131.stdout:Group : Unspecified 2026-02-12T22:24:41.380 INFO:teuthology.orchestra.run.trial131.stdout:Size : 7963769 2026-02-12T22:24:41.380 INFO:teuthology.orchestra.run.trial131.stdout:License : GPL-3.0-or-later 2026-02-12T22:24:41.380 INFO:teuthology.orchestra.run.trial131.stdout:Signature : 2026-02-12T22:24:41.380 INFO:teuthology.orchestra.run.trial131.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:24:41.380 INFO:teuthology.orchestra.run.trial131.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:24:41.380 INFO:teuthology.orchestra.run.trial131.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:24:41.380 INFO:teuthology.orchestra.run.trial131.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:24:41.380 INFO:teuthology.orchestra.run.trial131.stdout:Packager : Release Engineering 2026-02-12T22:24:41.380 INFO:teuthology.orchestra.run.trial131.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:24:41.380 INFO:teuthology.orchestra.run.trial131.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:24:41.380 INFO:teuthology.orchestra.run.trial131.stdout:Summary : Support tools for GRUB. 2026-02-12T22:24:41.381 INFO:teuthology.orchestra.run.trial131.stdout:Description : 2026-02-12T22:24:41.381 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T22:24:41.381 INFO:teuthology.orchestra.run.trial131.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:24:41.381 INFO:teuthology.orchestra.run.trial131.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:24:41.381 INFO:teuthology.orchestra.run.trial131.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:24:41.381 INFO:teuthology.orchestra.run.trial131.stdout:hardware devices. 2026-02-12T22:24:41.381 INFO:teuthology.orchestra.run.trial131.stdout: 2026-02-12T22:24:41.381 INFO:teuthology.orchestra.run.trial131.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:24:41.382 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:24:41.382 INFO:teuthology.task.kernel:Updating grub on trial131 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.383 DEBUG:teuthology.orchestra.run.trial131:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:24:41.406 DEBUG:teuthology.orchestra.run.trial048:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:24:41.449 INFO:teuthology.orchestra.run.trial131.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:24:41.450 DEBUG:teuthology.orchestra.run.trial131:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:24:41.515 INFO:teuthology.orchestra.run.trial131.stdout:/sbin/grubby 2026-02-12T22:24:41.517 INFO:teuthology.orchestra.run.trial131.stdout:yes 2026-02-12T22:24:41.517 DEBUG:teuthology.orchestra.run.trial131:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:24:41.518 INFO:teuthology.orchestra.run.trial048.stderr:Generating grub configuration file ... 2026-02-12T22:24:41.583 INFO:teuthology.orchestra.run.trial131.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:24:41.585 DEBUG:teuthology.orchestra.run.trial131:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:24:41.662 DEBUG:teuthology.orchestra.run.trial131:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:24:41.697 INFO:teuthology.orchestra.run.trial048.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:24:41.707 INFO:teuthology.orchestra.run.trial048.stderr:done 2026-02-12T22:24:41.709 DEBUG:teuthology.orchestra.run.trial048:> test -d /sys/firmware/efi 2026-02-12T22:24:41.726 DEBUG:teuthology.orchestra.run.trial048:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:24:41.773 INFO:teuthology.orchestra.run.trial131.stderr:Generating grub configuration file ... 2026-02-12T22:24:41.798 INFO:teuthology.orchestra.run.trial048.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:24:41.798 INFO:teuthology.orchestra.run.trial048.stdout:/boot/efi/EFI/rocky 2026-02-12T22:24:41.800 DEBUG:teuthology.orchestra.run.trial048:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:24:41.868 INFO:teuthology.orchestra.run.trial048.stdout:no 2026-02-12T22:24:41.868 DEBUG:teuthology.orchestra.run.trial048:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:24:41.934 INFO:teuthology.orchestra.run.trial048.stdout:yes 2026-02-12T22:24:41.935 DEBUG:teuthology.orchestra.run.trial048:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:24:41.952 INFO:teuthology.orchestra.run.trial131.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:24:41.962 INFO:teuthology.orchestra.run.trial131.stderr:done 2026-02-12T22:24:41.963 DEBUG:teuthology.orchestra.run.trial131:> test -d /sys/firmware/efi 2026-02-12T22:24:41.980 DEBUG:teuthology.orchestra.run.trial131:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:24:42.001 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial048 2026-02-12T22:24:42.002 DEBUG:teuthology.orchestra.run.trial048:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:24:42.048 INFO:teuthology.orchestra.run.trial131.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:24:42.049 INFO:teuthology.orchestra.run.trial131.stdout:/boot/efi/EFI/rocky 2026-02-12T22:24:42.050 DEBUG:teuthology.orchestra.run.trial131:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:24:42.066 INFO:teuthology.orchestra.run.trial048.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:24:42.119 INFO:teuthology.orchestra.run.trial131.stdout:no 2026-02-12T22:24:42.120 DEBUG:teuthology.orchestra.run.trial131:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:24:42.187 INFO:teuthology.orchestra.run.trial131.stdout:yes 2026-02-12T22:24:42.188 DEBUG:teuthology.orchestra.run.trial131:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:24:42.255 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial131 2026-02-12T22:24:42.255 DEBUG:teuthology.orchestra.run.trial131:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:24:42.319 INFO:teuthology.orchestra.run.trial131.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:25:12.044 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:12.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:12.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:12.154 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:12.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:12.232 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:12.232 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:12.288 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:12.289 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:12.289 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:12.289 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:12.298 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:12.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:12.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:12.404 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:12.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:12.489 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:12.489 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:12.546 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:12.547 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:12.547 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:12.547 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:13.291 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:13.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:13.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:13.399 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:13.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:13.476 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:13.476 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:13.534 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:13.534 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:13.535 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:13.535 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:13.549 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:13.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:13.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:13.653 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:13.731 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:13.731 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:13.731 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:13.788 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:13.788 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:13.788 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:13.789 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:14.536 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:14.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:14.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:14.643 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:14.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:14.727 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:14.727 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:14.784 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:14.784 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:14.784 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:14.784 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:14.790 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:14.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:14.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:14.895 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:14.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:14.971 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:14.971 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:15.029 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:15.029 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:15.029 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:15.029 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:15.785 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:15.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:15.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:15.893 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:15.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:15.972 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:15.972 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:16.029 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:16.030 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:16.030 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:16.030 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:16.031 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:16.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:16.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:16.134 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:16.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:16.211 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:16.211 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:16.268 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:16.268 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:16.268 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:16.269 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:17.031 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:17.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:17.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:17.140 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:17.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:17.223 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:17.224 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:17.269 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:17.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:17.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:17.281 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:17.282 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:17.282 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:17.282 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:17.374 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:17.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:17.450 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:17.450 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:17.507 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:17.508 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:17.508 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:17.508 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:18.283 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:18.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:18.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:18.391 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:18.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:18.481 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:18.481 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:18.509 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:18.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:18.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:18.613 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:18.623 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:18.623 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:18.623 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:18.623 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:18.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:18.693 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:18.693 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:18.752 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:18.752 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:18.752 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:18.752 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:19.624 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:19.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:19.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:19.732 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:19.754 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:19.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:19.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:19.819 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:19.828 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:19.828 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:19.828 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:19.885 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:19.886 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:19.886 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:19.886 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:19.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:19.902 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:19.902 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:19.960 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:19.960 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:19.960 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:19.960 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:20.886 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:20.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:20.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:20.985 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:20.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:20.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:21.037 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:21.046 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:21.055 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:21.055 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:21.055 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:21.112 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:21.112 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:21.112 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:21.112 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:21.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:21.119 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:21.119 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:21.175 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:21.176 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:21.176 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:21.176 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:22.113 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:22.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:22.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:22.210 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:22.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:22.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:22.262 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:22.271 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:22.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:22.279 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:22.280 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:22.336 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:22.336 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:22.337 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:22.337 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:22.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:22.356 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:22.356 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:22.413 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:22.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:22.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:22.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:23.338 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:23.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:23.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:23.436 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:23.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:23.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:23.487 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:23.495 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:23.545 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:23.545 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:23.545 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:23.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:23.566 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:23.566 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:23.602 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:23.603 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:23.603 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:23.603 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:23.623 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:23.624 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:23.624 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:23.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:24.604 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:24.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:24.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:24.703 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:24.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:24.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:24.755 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:24.763 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:24.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:24.773 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:24.773 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:24.829 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:24.829 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:24.829 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:24.830 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:24.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:24.841 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:24.842 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:24.899 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:24.899 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:24.899 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:24.900 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:25.830 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:25.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:25.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:25.929 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:25.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:25.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:25.981 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:25.990 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:25.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:25.998 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:25.999 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:26.055 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:26.055 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:26.055 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:26.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:26.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:26.066 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:26.066 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:26.123 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:26.123 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:26.123 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:26.123 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:27.056 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:27.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:27.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:27.155 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:27.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:27.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:27.206 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:27.215 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:27.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:27.224 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:27.225 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:27.282 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:27.282 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:27.282 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:27.282 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:27.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:27.291 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:27.291 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:27.348 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:27.349 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:27.349 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:27.349 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:28.283 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:28.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:28.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:28.382 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:28.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:28.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:28.434 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:28.442 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:28.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:28.451 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:28.451 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:28.508 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:28.509 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:28.509 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:28.509 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:28.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:28.514 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:28.514 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:28.571 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:28.572 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:28.572 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:28.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:29.510 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:29.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:29.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:29.607 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:29.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:29.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:29.659 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:29.668 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:29.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:29.677 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:29.677 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:29.734 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:29.734 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:29.735 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:29.735 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:29.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:29.740 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:29.740 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:29.797 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:29.797 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:29.797 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:29.797 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:30.735 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:30.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:30.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:30.834 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:30.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:30.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:30.886 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:30.894 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:30.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:30.904 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:30.904 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:30.960 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:30.960 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:30.960 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:30.960 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:30.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:30.970 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:30.970 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:31.028 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:31.028 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:31.029 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:31.029 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:31.962 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:31.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:31.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:32.061 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:32.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:32.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:32.113 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:32.122 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:32.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:32.131 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:32.131 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:32.187 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:32.188 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:32.188 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:32.188 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:32.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:32.197 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:32.197 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:32.253 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:32.254 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:32.254 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:32.254 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:33.189 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:33.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:33.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:33.288 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:33.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:33.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:33.339 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:33.347 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:33.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:33.397 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:33.397 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:33.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:33.430 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:33.430 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:33.454 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:33.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:33.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:33.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:33.486 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:33.486 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:33.487 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:33.487 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:34.455 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:34.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:34.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:34.553 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:34.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:34.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:34.605 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:34.613 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:34.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:34.622 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:34.622 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:34.679 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:34.679 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:34.679 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:34.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:34.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:34.694 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:34.694 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:34.753 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:34.753 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:34.753 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:34.753 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:35.681 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:35.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:35.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:35.779 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:35.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:35.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:35.804 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:35.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:35.900 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:35.900 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:35.909 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:35.959 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:35.959 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:35.959 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:35.960 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:35.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:35.998 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:35.998 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:36.055 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:36.055 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:36.055 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:36.056 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:36.961 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:36.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:36.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:37.058 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:37.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:37.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:37.111 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:37.120 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:37.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:37.129 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:37.129 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:37.186 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:37.186 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:37.186 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:37.186 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:37.208 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:37.208 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:37.208 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:37.264 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:37.265 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:37.265 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:37.265 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:38.187 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:38.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:38.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:38.286 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:38.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:38.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:38.338 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:38.347 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:38.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:38.356 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:38.356 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:38.413 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:38.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:38.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:38.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:38.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:38.440 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:38.440 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:38.498 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:38.499 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:38.499 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:38.499 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:39.415 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:39.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:39.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:39.513 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:39.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:39.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:39.565 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:39.573 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:39.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:39.583 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:39.583 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:39.640 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:39.640 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:39.640 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:39.640 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:39.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:39.649 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:39.650 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:39.707 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:39.707 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:39.707 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:39.707 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:40.641 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:40.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:40.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:40.740 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:40.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:40.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:40.792 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:40.800 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:40.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:40.810 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:40.810 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:40.868 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:40.868 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:40.868 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:40.868 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:40.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:40.874 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:40.874 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:40.931 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:40.932 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:40.932 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:40.932 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:41.869 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:41.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:41.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:41.968 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:41.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:41.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:42.020 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:42.028 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:42.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:42.037 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:42.037 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:42.095 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:42.095 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:42.095 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:42.095 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:42.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:42.103 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:42.103 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:42.159 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:42.159 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:42.160 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:42.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:43.096 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:43.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:43.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:43.194 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:43.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:43.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:43.246 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:43.255 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:43.264 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:43.264 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:43.264 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:43.321 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:43.321 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:43.321 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:43.321 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:43.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:43.331 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:43.331 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:43.389 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:43.390 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:43.390 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:43.390 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:44.322 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:44.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:44.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:44.424 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:44.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:44.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:44.476 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:44.485 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:44.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:44.494 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:44.494 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:44.551 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:44.551 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:44.551 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:44.551 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:44.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:44.561 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:44.561 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:44.617 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:44.617 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:44.617 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:44.617 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:45.552 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:45.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:45.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:45.651 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:45.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:45.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:45.703 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:45.711 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:45.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:45.720 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:45.720 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:45.778 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:45.778 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:45.778 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:45.778 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:45.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:45.789 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:45.789 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:45.846 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:45.847 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:45.847 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:45.847 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:46.779 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:46.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:46.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:46.877 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:46.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:46.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:46.930 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:46.938 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:46.947 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:46.947 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:46.947 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:47.005 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:47.005 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:47.005 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:47.005 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:47.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:47.015 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:47.015 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:47.072 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:47.073 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:47.073 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:47.073 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:48.005 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:48.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:48.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:48.114 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:48.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:48.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:48.166 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:48.174 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:48.183 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:48.183 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:48.183 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:48.241 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:48.241 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:48.241 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:48.241 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:48.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:48.245 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:48.245 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:48.302 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:48.302 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:48.302 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:48.303 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:49.241 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:49.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:49.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:49.326 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:49.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:49.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:49.378 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:49.387 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:49.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:49.396 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:49.396 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:49.455 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:49.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:49.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:49.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:49.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:49.469 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:49.469 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:49.526 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:49.526 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:49.526 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:49.526 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:50.455 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:50.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:50.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:50.520 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:50.528 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:50.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:50.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:50.592 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:50.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:50.604 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:50.604 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:50.661 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:50.661 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:50.661 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:50.661 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:50.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:50.680 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:50.680 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:50.737 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:50.738 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:50.738 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:50.738 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:51.662 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:51.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:51.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:51.762 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:51.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:51.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:51.814 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:51.822 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:51.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:51.831 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:51.832 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:51.889 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:51.889 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:51.889 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:51.889 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:51.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:51.904 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:51.904 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:51.961 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:51.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:51.962 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:51.962 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:52.890 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:52.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:52.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:52.988 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:52.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:52.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:53.040 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:53.049 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:53.058 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:53.058 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:53.058 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:53.115 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:53.115 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:53.115 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:53.115 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:53.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:53.127 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:53.128 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:53.185 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:53.185 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:53.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:53.186 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:54.116 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:54.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:54.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:54.215 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:54.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:54.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:54.267 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:54.276 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:54.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:54.285 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:54.285 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:54.343 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:54.343 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:54.343 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:54.343 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:54.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:54.361 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:54.361 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:54.419 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:54.419 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:54.419 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:54.419 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:55.344 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:55.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:55.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:55.443 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:55.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:55.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:55.495 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:55.504 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:55.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:55.513 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:55.513 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:55.569 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:55.569 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:55.570 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:55.570 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:55.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:55.586 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:55.587 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:55.644 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:55.645 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:55.645 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:55.645 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:56.571 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:56.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:56.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:56.670 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:56.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:56.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:56.723 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:56.731 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:56.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:56.740 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:56.740 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:56.797 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:56.797 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:56.797 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:56.797 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:56.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:56.815 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:56.815 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:56.873 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:56.873 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:56.873 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:56.873 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:57.798 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:57.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:57.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:57.897 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:57.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:57.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:57.949 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:57.958 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:57.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:57.967 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:57.967 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:58.024 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:58.024 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:58.024 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:58.024 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:58.035 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:58.035 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:58.035 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:58.092 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:58.093 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:58.093 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:58.093 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:59.026 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:25:59.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:59.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:59.124 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:25:59.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:59.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:25:59.177 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:25:59.185 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:25:59.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:25:59.195 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:59.195 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:25:59.252 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:59.252 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:59.252 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:59.252 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:25:59.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:25:59.266 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:25:59.267 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:25:59.323 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:25:59.324 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:25:59.324 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:25:59.324 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:00.253 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:00.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:00.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:00.350 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:00.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:00.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:00.402 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:00.411 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:00.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:00.420 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:00.420 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:00.478 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:00.478 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:00.478 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:00.478 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:00.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:00.499 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:00.499 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:00.556 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:00.557 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:00.557 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:00.557 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:01.479 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:01.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:01.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:01.576 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:01.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:01.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:01.629 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:01.637 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:01.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:01.646 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:01.646 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:01.703 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:01.703 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:01.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:01.704 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:01.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:01.711 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:01.711 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:01.769 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:01.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:01.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:01.770 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:02.705 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:02.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:02.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:02.803 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:02.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:02.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:02.855 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:02.864 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:02.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:02.873 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:02.873 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:02.929 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:02.929 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:02.929 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:02.929 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:02.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:02.949 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:02.950 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:03.007 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:03.007 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:03.007 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:03.008 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:03.930 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:03.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:03.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:04.012 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:04.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:04.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:04.064 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:04.072 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:04.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:04.081 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:04.081 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:04.138 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:04.138 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:04.138 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:04.138 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:04.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:04.156 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:04.156 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:04.213 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:04.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:04.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:04.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:05.139 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:05.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:05.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:05.226 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:05.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:05.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:05.282 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:05.290 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:05.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:05.300 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:05.300 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:05.357 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:05.357 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:05.357 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:05.357 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:05.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:05.370 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:05.370 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:05.427 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:05.428 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:05.428 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:05.428 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:06.358 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:06.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:06.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:06.456 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:06.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:06.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:06.508 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:06.516 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:06.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:06.525 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:06.525 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:06.583 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:06.583 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:06.583 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:06.583 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:06.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:06.600 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:06.600 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:06.657 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:06.658 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:06.658 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:06.658 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:07.584 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:07.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:07.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:07.682 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:07.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:07.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:07.734 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:07.742 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:07.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:07.751 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:07.751 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:07.807 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:07.807 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:07.808 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:07.808 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:07.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:07.816 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:07.816 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:07.873 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:07.873 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:07.874 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:07.874 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:08.809 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:08.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:08.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:08.907 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:08.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:08.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:08.959 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:08.968 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:08.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:08.977 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:08.977 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:09.034 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:09.034 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:09.034 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:09.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:09.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:09.052 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:09.052 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:09.109 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:09.110 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:09.110 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:09.110 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:10.035 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:10.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:10.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:10.135 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:10.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:10.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:10.187 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:10.195 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:10.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:10.204 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:10.204 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:10.261 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:10.261 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:10.261 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:10.261 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:10.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:10.270 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:10.270 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:10.327 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:10.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:10.328 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:10.328 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:11.261 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:11.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:11.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:11.347 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:11.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:11.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:11.400 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:11.408 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:11.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:11.417 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:11.417 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:11.474 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:11.474 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:11.474 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:11.474 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:11.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:11.491 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:11.491 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:11.547 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:11.548 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:11.548 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:11.548 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:12.475 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:12.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:12.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:12.545 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:12.549 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:12.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:12.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:12.613 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:12.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:12.622 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:12.622 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:12.678 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:12.678 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:12.678 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:12.678 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:12.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:12.698 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:12.698 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:12.754 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:12.755 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:12.755 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:12.755 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:13.679 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:13.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:13.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:13.778 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:13.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:13.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:13.830 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:13.838 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:13.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:13.847 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:13.847 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:13.904 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:13.905 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:13.905 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:13.905 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:13.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:13.928 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:13.928 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:13.985 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:13.986 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:13.986 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:13.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:14.905 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:14.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:14.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:15.004 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:15.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:15.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:15.056 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:15.064 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:15.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:15.074 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:15.074 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:15.133 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:15.133 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:15.133 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:15.133 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:15.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:15.144 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:15.144 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:15.201 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:15.202 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:15.202 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:15.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:16.134 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:16.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:16.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:16.233 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:16.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:16.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:16.287 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:16.297 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:16.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:16.306 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:16.307 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:16.363 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:16.363 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:16.363 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:16.363 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:16.371 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:16.371 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:16.371 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:16.428 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:16.428 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:16.428 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:16.428 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:17.364 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:17.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:17.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:17.449 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:17.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:17.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:17.501 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:17.509 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:17.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:17.518 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:17.518 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:17.574 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:17.574 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:17.574 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:17.574 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:17.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:17.599 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:17.600 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:17.656 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:17.657 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:17.657 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:17.657 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:18.575 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:18.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:18.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:18.674 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:18.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:18.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:18.726 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:18.735 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:18.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:18.744 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:18.744 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:18.801 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:18.801 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:18.801 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:18.801 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:18.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:18.821 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:18.821 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:18.879 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:18.879 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:18.879 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:18.879 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:19.802 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:19.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:19.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:19.899 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:19.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:19.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:19.952 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:19.961 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:19.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:19.970 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:19.970 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:20.029 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:20.029 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:20.029 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:20.029 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:20.044 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:20.044 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:20.045 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:20.101 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:20.101 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:20.101 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:20.101 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:21.031 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:21.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:21.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:21.130 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:21.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:21.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:21.182 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:21.191 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:21.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:21.200 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:21.200 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:21.257 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:21.257 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:21.257 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:21.257 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:21.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:21.279 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:21.279 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:21.336 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:21.337 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:21.337 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:21.337 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:22.258 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:22.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:22.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:22.330 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:22.338 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:22.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:22.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:22.404 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:22.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:22.412 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:22.412 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:22.469 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:22.469 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:22.469 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:22.469 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:22.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:22.477 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:22.477 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:22.533 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:22.534 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:22.534 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:22.534 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:23.470 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:23.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:23.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:23.569 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:23.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:23.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:23.621 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:23.630 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:23.639 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:23.639 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:23.639 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:23.696 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:23.696 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:23.696 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:23.696 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:23.707 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:23.707 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:23.707 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:23.763 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:23.763 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:23.763 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:23.764 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:24.697 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:24.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:24.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:24.778 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:24.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:24.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:24.841 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:24.850 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:24.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:24.861 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:24.861 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:24.917 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:24.917 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:24.917 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:24.917 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:24.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:24.923 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:24.923 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:24.979 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:24.979 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:24.979 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:24.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:25.918 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:25.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:25.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:26.016 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:26.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:26.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:26.026 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:26.077 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:26.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:26.108 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:26.108 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:26.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:26.159 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:26.159 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:26.164 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:26.164 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:26.164 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:26.164 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:26.218 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:26.218 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:26.218 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:26.219 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:27.165 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:27.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:27.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:27.263 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:27.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:27.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:27.315 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:27.324 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:27.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:27.333 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:27.333 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:27.390 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:27.390 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:27.390 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:27.390 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:27.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:27.397 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:27.397 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:27.454 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:27.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:27.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:27.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:28.391 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:28.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:28.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:28.490 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:28.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:28.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:28.542 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:28.550 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:28.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:28.559 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:28.559 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:28.615 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:28.616 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:28.616 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:28.616 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:28.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:28.637 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:28.638 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:28.694 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:28.695 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:28.695 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:28.695 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:29.617 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:29.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:29.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:29.714 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:29.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:29.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:29.767 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:29.775 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:29.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:29.784 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:29.784 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:29.840 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:29.841 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:29.841 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:29.841 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:29.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:29.858 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:29.858 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:29.915 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:29.915 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:29.915 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:29.915 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:30.842 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:30.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:30.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:30.940 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:30.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:30.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:30.992 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:31.000 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:31.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:31.010 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:31.010 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:31.067 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:31.067 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:31.067 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:31.067 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:31.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:31.074 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:31.074 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:31.132 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:31.132 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:31.132 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:31.132 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:32.067 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:32.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:32.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:32.165 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:32.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:32.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:32.217 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:32.226 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:32.235 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:32.235 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:32.235 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:32.292 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:32.292 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:32.292 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:32.292 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:32.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:32.308 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:32.309 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:32.365 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:32.366 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:32.366 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:32.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:33.293 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:33.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:33.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:33.386 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:33.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:33.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:33.438 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:33.447 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:33.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:33.456 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:33.456 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:33.513 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:33.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:33.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:33.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:33.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:33.520 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:33.520 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:33.577 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:33.578 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:33.578 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:33.578 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:34.514 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:34.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:34.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:34.612 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:34.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:34.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:34.665 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:34.673 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:34.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:34.683 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:34.683 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:34.741 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:34.742 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:34.742 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:34.742 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:34.757 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:34.757 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:34.757 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:34.814 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:34.815 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:34.815 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:34.815 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:35.743 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:35.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:35.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:35.824 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:35.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:35.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:35.875 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:35.884 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:35.893 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:35.893 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:35.893 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:35.950 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:35.950 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:35.950 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:35.950 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:35.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:35.968 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:35.968 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:36.025 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:36.025 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:36.025 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:36.025 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:36.951 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:36.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:36.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:37.049 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:37.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:37.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:37.102 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:37.110 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:37.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:37.120 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:37.120 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:37.177 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:37.177 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:37.177 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:37.177 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:37.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:37.195 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:37.195 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:37.251 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:37.252 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:37.252 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:37.252 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:38.178 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:38.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:38.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:38.251 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:38.252 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:38.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:38.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:38.324 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:38.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:38.333 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:38.333 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:38.392 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:38.392 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:38.392 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:38.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:38.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:38.407 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:38.407 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:38.465 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:38.465 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:38.465 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:38.466 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:39.394 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:39.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:39.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:39.493 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:39.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:39.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:39.545 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:39.554 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:39.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:39.563 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:39.563 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:39.619 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:39.619 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:39.619 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:39.619 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:39.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:39.631 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:39.631 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:39.688 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:39.688 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:39.688 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:39.688 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:40.621 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:40.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:40.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:40.718 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:40.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:40.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:40.771 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:40.779 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:40.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:40.789 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:40.789 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:40.845 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:40.846 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:40.846 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:40.846 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:40.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:40.852 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:40.853 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:40.910 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:40.910 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:40.910 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:40.910 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:41.846 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:41.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:41.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:41.924 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:41.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:41.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:41.976 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:41.985 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:41.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:41.994 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:41.994 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:42.050 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:42.050 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:42.050 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:42.051 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:42.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:42.074 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:42.074 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:42.131 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:42.131 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:42.131 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:42.131 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:43.052 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:43.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:43.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:43.150 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:43.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:43.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:43.202 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:43.211 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:43.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:43.220 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:43.220 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:43.277 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:43.277 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:43.277 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:43.277 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:43.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:43.290 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:43.290 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:43.346 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:43.347 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:43.347 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:43.347 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:44.278 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:44.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:44.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:44.376 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:44.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:44.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:44.429 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:44.437 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:44.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:44.446 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:44.446 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:44.502 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:44.502 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:44.502 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:44.503 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:44.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:44.520 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:44.520 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:44.577 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:44.577 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:44.577 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:44.578 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:45.503 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:45.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:45.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:45.602 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:45.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:45.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:45.655 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:45.664 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:45.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:45.672 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:45.672 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:45.729 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:45.729 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:45.729 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:45.729 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:45.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:45.738 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:45.738 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:45.794 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:45.794 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:45.794 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:45.794 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:46.730 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:46.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:46.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:46.829 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:46.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:46.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:46.881 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:46.890 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:46.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:46.899 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:46.899 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:46.955 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:46.956 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:46.956 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:46.956 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:46.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:46.966 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:46.966 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:47.023 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:47.024 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:47.024 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:47.024 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:47.957 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:47.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:47.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:48.057 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:48.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:48.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:48.109 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:48.118 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:48.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:48.127 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:48.127 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:48.184 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:48.184 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:48.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:48.185 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:48.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:48.190 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:48.190 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:48.247 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:48.248 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:48.248 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:48.248 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:49.185 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:49.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:49.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:49.294 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:49.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:49.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:49.345 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:49.354 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:49.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:49.363 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:49.363 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:49.420 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:49.420 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:49.420 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:49.420 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:49.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:49.430 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:49.430 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:49.487 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:49.487 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:49.487 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:49.487 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:50.421 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:50.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:50.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:50.519 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:50.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:50.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:50.572 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:50.580 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:50.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:50.589 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:50.590 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:50.646 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:50.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:50.646 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:50.647 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:50.661 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:50.661 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:50.661 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:50.717 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:50.717 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:50.717 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:50.717 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:51.647 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:51.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:51.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:51.746 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:51.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:51.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:51.798 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:51.807 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:51.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:51.858 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:51.858 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:51.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:51.898 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:51.898 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:51.915 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:51.915 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:51.915 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:51.915 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:51.957 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:51.957 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:51.957 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:51.957 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:52.915 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:52.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:52.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:53.014 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:53.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:53.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:53.086 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:53.095 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:53.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:53.104 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:53.104 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:53.161 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:53.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:53.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:53.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:53.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:53.169 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:53.169 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:53.227 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:53.227 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:53.227 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:53.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:54.162 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:54.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:54.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:54.261 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:54.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:54.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:54.313 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:54.321 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:54.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:54.331 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:54.331 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:54.388 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:54.389 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:54.389 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:54.389 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:54.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:54.395 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:54.395 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:54.452 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:54.452 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:54.453 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:54.453 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:55.390 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:55.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:55.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:55.463 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:55.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:55.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:55.515 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:55.523 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:55.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:55.532 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:55.532 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:55.590 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:55.590 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:55.590 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:55.590 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:55.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:55.616 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:55.616 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:55.673 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:55.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:55.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:55.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:56.591 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:56.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:56.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:56.690 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:56.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:56.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:56.742 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:56.751 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:56.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:56.761 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:56.761 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:56.818 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:56.818 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:56.818 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:56.818 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:56.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:56.841 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:56.841 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:56.898 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:56.899 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:56.899 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:56.899 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:57.819 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:57.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:57.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:57.918 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:57.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:57.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:57.971 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:57.979 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:57.988 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:57.988 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:57.988 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:58.045 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:58.045 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:58.045 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:58.045 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:58.058 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:58.058 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:58.058 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:58.116 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:58.116 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:58.116 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:58.116 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:59.046 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:26:59.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:59.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:59.144 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:26:59.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:59.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:26:59.196 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:26:59.204 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:26:59.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:26:59.213 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:59.213 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:26:59.270 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:59.271 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:59.271 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:59.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:26:59.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:26:59.281 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:26:59.281 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:26:59.338 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:26:59.338 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:26:59.338 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:26:59.339 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:00.272 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:00.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:00.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:00.371 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:00.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:00.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:00.423 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:00.432 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:00.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:00.441 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:00.441 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:00.498 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:00.498 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:00.498 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:00.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:00.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:00.513 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:00.513 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:00.571 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:00.572 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:00.572 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:00.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:01.500 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:01.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:01.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:01.598 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:01.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:01.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:01.651 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:01.659 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:01.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:01.669 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:01.669 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:01.726 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:01.726 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:01.726 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:01.726 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:01.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:01.745 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:01.745 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:01.802 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:01.803 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:01.803 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:01.803 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:02.727 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:02.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:02.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:02.826 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:02.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:02.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:02.879 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:02.887 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:02.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:02.897 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:02.897 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:02.954 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:02.954 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:02.954 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:02.954 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:02.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:02.968 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:02.968 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:03.026 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:03.026 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:03.026 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:03.027 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:03.955 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:03.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:03.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:04.053 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:04.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:04.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:04.106 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:04.115 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:04.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:04.124 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:04.124 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:04.181 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:04.181 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:04.181 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:04.181 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:04.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:04.202 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:04.202 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:04.261 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:04.262 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:04.262 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:04.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:05.182 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:05.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:05.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:05.281 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:05.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:05.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:05.333 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:05.342 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:05.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:05.351 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:05.351 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:05.407 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:05.408 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:05.408 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:05.408 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:05.419 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:05.419 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:05.419 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:05.476 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:05.476 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:05.476 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:05.476 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:06.409 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:06.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:06.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:06.507 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:06.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:06.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:06.560 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:06.568 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:06.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:06.577 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:06.578 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:06.635 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:06.635 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:06.635 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:06.635 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:06.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:06.642 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:06.642 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:06.700 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:06.700 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:06.700 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:06.700 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:07.637 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:07.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:07.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:07.735 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:07.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:07.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:07.787 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:07.796 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:07.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:07.805 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:07.805 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:07.862 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:07.863 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:07.863 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:07.863 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:07.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:07.878 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:07.878 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:07.936 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:07.936 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:07.936 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:07.936 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:08.864 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:08.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:08.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:08.964 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:08.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:08.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:09.016 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:09.025 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:09.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:09.034 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:09.034 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:09.092 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:09.092 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:09.092 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:09.092 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:09.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:09.106 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:09.106 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:09.164 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:09.164 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:09.164 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:09.164 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:10.093 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:10.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:10.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:10.191 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:10.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:10.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:10.244 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:10.252 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:10.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:10.262 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:10.262 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:10.320 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:10.320 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:10.320 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:10.320 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:10.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:10.340 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:10.341 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:10.398 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:10.398 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:10.398 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:10.398 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:11.321 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:11.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:11.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:11.420 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:11.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:11.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:11.471 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:11.480 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:11.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:11.491 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:11.491 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:11.547 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:11.547 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:11.548 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:11.548 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:11.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:11.554 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:11.554 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:11.612 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:11.613 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:11.613 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:11.613 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:12.548 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:12.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:12.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:12.648 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:12.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:12.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:12.701 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:12.709 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:12.719 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:12.719 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:12.719 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:12.775 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:12.775 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:12.775 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:12.775 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:12.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:12.787 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:12.787 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:12.844 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:12.844 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:12.844 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:12.844 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:13.775 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:13.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:13.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:13.875 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:13.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:13.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:13.928 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:13.936 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:13.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:13.946 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:13.946 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:14.002 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:14.002 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:14.002 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:14.002 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:14.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:14.012 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:14.013 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:14.070 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:14.070 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:14.070 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:14.071 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:15.004 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:15.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:15.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:15.103 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:15.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:15.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:15.156 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:15.164 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:15.173 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:15.173 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:15.173 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:15.231 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:15.231 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:15.231 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:15.231 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:15.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:15.245 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:15.245 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:15.302 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:15.302 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:15.302 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:15.302 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:16.232 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:16.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:16.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:16.330 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:16.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:16.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:16.382 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:16.390 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:16.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:16.399 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:16.400 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:16.457 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:16.457 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:16.457 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:16.457 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:16.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:16.477 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:16.477 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:16.534 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:16.534 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:16.534 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:16.534 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:17.458 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:17.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:17.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:17.558 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:17.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:17.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:17.611 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:17.619 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:17.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:17.629 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:17.629 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:17.686 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:17.686 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:17.686 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:17.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:17.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:17.700 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:17.700 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:17.757 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:17.757 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:17.758 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:17.758 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:18.687 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:18.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:18.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:18.785 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:18.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:18.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:18.837 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:18.846 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:18.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:18.855 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:18.855 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:18.911 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:18.912 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:18.912 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:18.912 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:18.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:18.934 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:18.934 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:18.991 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:18.992 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:18.992 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:18.992 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:19.913 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:19.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:19.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:20.011 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:20.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:20.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:20.064 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:20.072 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:20.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:20.081 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:20.081 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:20.139 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:20.139 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:20.139 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:20.139 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:20.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:20.159 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:20.159 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:20.217 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:20.217 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:20.217 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:20.217 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:21.140 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:21.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:21.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:21.238 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:21.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:21.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:21.290 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:21.298 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:21.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:21.307 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:21.307 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:21.364 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:21.364 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:21.364 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:21.364 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:21.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:21.385 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:21.385 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:21.443 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:21.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:21.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:21.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:22.365 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:22.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:22.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:22.463 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:22.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:22.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:22.514 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:22.522 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:22.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:22.531 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:22.531 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:22.588 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:22.589 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:22.589 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:22.589 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:22.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:22.606 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:22.606 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:22.662 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:22.663 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:22.663 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:22.663 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:23.591 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:23.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:23.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:23.689 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:23.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:23.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:23.741 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:23.749 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:23.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:23.759 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:23.759 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:23.817 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:23.817 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:23.817 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:23.818 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:23.828 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:23.828 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:23.828 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:23.886 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:23.886 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:23.886 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:23.886 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:24.819 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:24.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:24.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:24.917 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:24.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:24.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:24.969 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:24.978 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:24.987 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:24.987 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:24.987 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:25.044 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:25.044 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:25.044 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:25.044 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:25.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:25.062 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:25.062 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:25.120 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:25.120 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:25.120 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:25.120 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:26.045 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:26.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:26.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:26.143 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:26.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:26.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:26.196 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:26.204 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:26.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:26.214 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:26.214 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:26.271 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:26.271 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:26.271 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:26.272 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:26.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:26.283 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:26.283 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:26.340 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:26.340 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:26.340 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:26.340 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:27.272 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:27.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:27.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:27.371 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:27.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:27.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:27.423 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:27.431 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:27.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:27.441 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:27.441 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:27.498 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:27.498 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:27.498 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:27.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:27.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:27.516 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:27.516 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:27.573 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:27.573 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:27.573 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:27.573 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:28.499 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:28.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:28.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:28.598 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:28.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:28.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:28.650 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:28.658 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:28.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:28.668 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:28.668 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:28.725 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:28.725 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:28.725 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:28.725 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:28.739 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:28.739 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:28.739 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:28.796 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:28.797 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:28.797 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:28.797 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:29.726 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:29.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:29.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:29.826 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:29.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:29.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:29.879 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:29.887 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:29.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:29.896 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:29.896 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:29.953 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:29.953 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:29.953 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:29.953 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:29.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:29.971 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:29.971 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:30.028 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:30.029 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:30.029 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:30.029 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:30.954 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:30.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:30.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:31.052 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:31.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:31.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:31.104 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:31.112 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:31.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:31.122 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:31.122 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:31.179 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:31.179 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:31.179 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:31.179 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:31.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:31.193 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:31.193 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:31.250 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:31.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:31.251 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:31.251 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:32.180 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:32.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:32.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:32.278 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:32.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:32.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:32.331 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:32.339 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:32.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:32.348 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:32.348 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:32.406 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:32.406 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:32.406 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:32.406 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:32.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:32.434 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:32.434 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:32.492 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:32.493 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:32.493 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:32.493 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:33.407 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:33.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:33.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:33.504 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:33.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:33.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:33.556 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:33.566 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:33.575 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:33.575 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:33.575 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:33.632 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:33.632 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:33.632 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:33.632 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:33.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:33.654 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:33.654 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:33.712 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:33.712 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:33.712 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:33.712 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:34.633 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:34.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:34.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:34.732 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:34.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:34.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:34.784 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:34.792 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:34.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:34.802 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:34.802 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:34.859 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:34.859 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:34.859 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:34.859 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:34.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:34.869 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:34.869 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:34.928 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:34.928 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:34.928 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:34.929 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:35.860 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:35.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:35.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:35.930 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:35.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:35.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:35.937 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:35.995 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:36.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:36.029 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:36.029 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:36.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:36.065 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:36.065 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:36.085 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:36.085 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:36.085 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:36.085 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:36.122 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:36.123 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:36.123 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:36.123 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:37.086 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:37.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:37.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:37.185 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:37.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:37.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:37.238 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:37.247 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:37.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:37.256 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:37.256 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:37.313 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:37.313 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:37.313 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:37.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:37.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:37.327 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:37.327 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:37.383 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:37.384 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:37.384 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:37.384 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:38.314 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:38.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:38.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:38.412 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:38.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:38.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:38.464 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:38.472 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:38.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:38.482 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:38.482 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:38.540 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:38.540 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:38.540 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:38.540 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:38.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:38.547 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:38.547 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:38.605 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:38.605 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:38.605 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:38.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:39.540 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:39.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:39.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:39.639 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:39.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:39.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:39.691 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:39.700 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:39.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:39.709 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:39.709 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:39.765 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:39.765 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:39.766 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:39.766 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:39.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:39.776 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:39.776 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:39.834 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:39.834 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:39.834 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:39.835 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:40.766 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:40.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:40.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:40.861 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:40.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:40.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:40.913 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:40.922 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:40.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:40.931 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:40.931 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:40.989 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:40.989 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:40.989 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:40.989 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:41.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:41.007 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:41.007 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:41.064 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:41.064 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:41.064 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:41.064 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:41.990 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:41.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:41.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:42.094 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:42.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:42.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:42.167 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:42.176 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:42.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:42.185 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:42.185 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:42.242 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:42.242 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:42.242 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:42.242 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:42.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:42.263 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:42.264 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:42.320 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:42.320 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:42.321 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:42.321 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:43.243 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:43.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:43.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:43.352 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:43.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:43.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:43.423 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:43.431 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:43.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:43.441 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:43.441 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:43.497 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:43.497 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:43.497 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:43.497 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:43.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:43.521 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:43.521 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:43.577 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:43.578 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:43.578 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:43.578 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:44.499 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:44.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:44.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:44.596 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:44.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:44.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:44.648 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:44.657 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:44.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:44.666 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:44.666 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:44.723 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:44.724 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:44.724 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:44.724 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:44.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:44.733 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:44.733 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:44.790 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:44.791 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:44.791 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:44.791 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:45.725 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:45.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:45.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:45.824 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:45.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:45.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:45.876 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:45.885 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:45.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:45.894 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:45.894 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:45.951 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:45.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:45.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:45.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:45.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:45.959 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:45.959 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:46.017 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:46.017 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:46.017 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:46.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:46.952 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:46.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:46.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:47.052 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:47.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:47.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:47.103 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:47.112 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:47.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:47.121 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:47.121 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:47.177 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:47.178 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:47.178 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:47.178 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:47.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:47.199 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:47.199 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:47.256 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:47.256 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:47.256 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:47.256 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:48.179 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:48.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:48.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:48.308 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:48.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:48.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:48.318 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:48.384 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:48.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:48.399 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:48.399 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:48.456 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:48.456 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:48.456 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:48.456 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:48.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:48.458 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:48.458 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:48.518 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:48.518 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:48.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:48.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:49.457 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:49.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:49.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:49.556 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:49.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:49.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:49.608 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:49.617 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:49.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:49.626 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:49.626 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:49.684 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:49.684 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:49.684 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:49.684 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:49.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:49.694 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:49.694 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:49.751 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:49.751 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:49.751 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:49.751 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:50.685 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:50.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:50.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:50.783 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:50.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:50.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:50.836 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:50.844 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:50.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:50.853 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:50.853 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:50.910 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:50.910 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:50.910 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:50.910 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:50.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:50.919 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:50.919 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:50.976 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:50.977 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:50.977 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:50.977 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:51.911 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:51.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:51.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:52.009 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:52.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:52.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:52.062 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:52.071 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:52.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:52.080 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:52.080 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:52.137 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:52.137 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:52.137 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:52.137 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:52.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:52.144 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:52.144 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:52.201 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:52.201 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:52.201 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:52.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:53.138 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:53.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:53.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:53.215 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:53.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:53.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:53.266 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:53.275 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:53.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:53.284 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:53.284 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:53.341 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:53.341 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:53.341 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:53.341 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:53.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:53.352 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:53.352 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:53.409 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:53.409 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:53.409 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:53.410 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:54.342 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:54.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:54.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:54.407 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:54.410 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:54.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:54.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:54.472 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:54.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:54.482 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:54.482 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:54.538 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:54.539 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:54.539 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:54.539 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:54.553 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:54.554 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:54.554 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:54.611 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:54.611 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:54.611 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:54.611 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:55.540 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:55.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:55.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:55.618 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:55.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:55.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:55.676 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:55.684 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:55.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:55.694 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:55.694 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:55.750 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:55.750 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:55.750 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:55.750 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:55.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:55.758 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:55.759 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:55.816 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:55.816 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:55.816 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:55.816 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:56.751 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:56.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:56.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:56.850 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:56.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:56.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:56.922 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:56.932 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:56.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:56.941 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:56.941 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:56.998 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:56.998 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:56.998 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:56.998 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:57.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:57.009 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:57.009 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:57.067 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:57.067 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:57.067 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:57.067 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:57.999 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:58.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:58.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:58.102 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:58.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:58.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:58.175 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:58.184 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:58.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:58.192 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:58.193 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:58.250 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:58.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:58.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:58.250 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:58.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:58.271 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:58.271 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:58.328 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:58.328 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:58.328 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:58.328 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:59.251 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:27:59.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:59.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:59.359 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:27:59.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:59.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:27:59.410 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:27:59.418 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:27:59.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:27:59.428 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:59.428 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:27:59.485 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:59.485 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:59.485 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:59.485 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:27:59.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:27:59.503 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:27:59.503 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:27:59.561 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:27:59.561 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:27:59.561 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:27:59.561 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:00.486 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:00.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:00.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:00.584 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:00.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:00.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:00.636 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:00.645 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:00.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:00.654 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:00.654 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:00.711 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:00.711 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:00.711 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:00.711 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:00.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:00.728 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:00.728 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:00.785 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:00.785 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:00.786 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:00.786 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:01.712 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:01.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:01.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:01.812 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:01.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:01.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:01.865 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:01.873 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:01.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:01.882 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:01.882 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:01.939 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:01.939 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:01.939 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:01.939 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:01.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:01.948 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:01.948 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:02.005 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:02.005 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:02.005 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:02.005 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:02.940 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:02.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:02.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:03.007 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:03.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:03.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:03.008 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:03.069 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:03.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:03.094 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:03.095 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:03.152 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:03.152 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:03.152 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:03.152 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:03.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:03.154 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:03.154 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:03.211 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:03.211 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:03.212 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:03.212 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:04.153 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:04.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:04.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:04.214 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:04.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:04.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:04.265 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:04.274 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:04.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:04.283 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:04.283 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:04.340 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:04.340 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:04.340 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:04.340 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:04.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:04.350 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:04.350 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:04.407 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:04.408 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:04.408 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:04.408 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:05.341 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:05.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:05.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:05.441 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:05.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:05.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:05.493 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:05.502 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:05.511 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:05.511 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:05.511 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:05.569 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:05.569 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:05.569 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:05.569 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:05.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:05.577 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:05.577 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:05.633 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:05.633 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:05.634 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:05.634 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:06.570 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:06.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:06.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:06.669 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:06.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:06.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:06.721 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:06.730 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:06.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:06.738 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:06.739 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:06.795 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:06.796 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:06.796 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:06.796 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:06.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:06.804 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:06.804 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:06.861 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:06.861 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:06.861 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:06.861 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:07.796 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:07.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:07.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:07.895 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:07.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:07.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:07.947 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:07.956 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:07.965 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:07.965 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:07.965 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:08.021 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:08.022 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:08.022 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:08.022 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:08.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:08.031 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:08.031 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:08.089 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:08.089 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:08.089 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:08.089 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:09.023 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:09.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:09.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:09.121 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:09.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:09.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:09.174 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:09.182 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:09.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:09.191 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:09.191 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:09.249 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:09.249 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:09.249 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:09.249 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:09.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:09.257 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:09.257 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:09.315 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:09.315 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:09.316 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:09.316 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:10.250 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:10.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:10.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:10.351 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:10.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:10.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:10.403 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:10.412 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:10.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:10.421 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:10.421 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:10.478 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:10.478 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:10.478 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:10.478 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:10.486 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:10.486 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:10.486 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:10.543 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:10.543 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:10.544 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:10.544 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:11.479 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:11.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:11.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:11.576 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:11.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:11.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:11.629 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:11.637 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:11.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:11.647 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:11.647 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:11.704 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:11.704 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:11.704 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:11.704 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:11.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:11.709 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:11.709 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:11.765 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:11.766 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:11.766 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:11.766 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:12.705 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:12.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:12.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:12.804 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:12.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:12.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:12.856 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:12.864 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:12.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:12.874 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:12.874 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:12.931 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:12.931 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:12.931 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:12.931 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:12.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:12.946 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:12.946 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:13.002 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:13.002 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:13.002 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:13.003 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:13.932 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:13.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:13.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:14.033 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:14.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:14.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:14.085 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:14.093 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:14.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:14.103 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:14.103 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:14.160 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:14.160 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:14.160 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:14.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:14.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:14.168 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:14.169 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:14.226 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:14.226 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:14.226 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:14.226 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:15.161 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:15.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:15.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:15.261 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:15.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:15.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:15.313 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:15.321 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:15.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:15.330 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:15.330 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:15.387 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:15.387 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:15.388 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:15.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:15.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:15.397 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:15.397 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:15.454 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:15.454 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:15.454 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:15.454 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:16.388 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:16.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:16.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:16.488 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:16.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:16.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:16.539 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:16.548 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:16.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:16.557 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:16.557 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:16.614 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:16.614 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:16.614 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:16.614 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:16.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:16.624 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:16.625 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:16.682 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:16.682 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:16.682 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:16.682 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:17.615 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:17.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:17.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:17.714 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:17.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:17.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:17.766 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:17.775 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:17.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:17.784 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:17.784 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:17.842 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:17.842 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:17.842 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:17.842 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:17.861 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:17.861 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:17.861 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:17.918 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:17.919 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:17.919 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:17.919 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:18.843 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:18.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:18.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:18.943 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:18.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:18.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:18.995 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:19.004 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:19.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:19.013 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:19.013 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:19.070 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:19.070 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:19.070 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:19.070 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:19.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:19.092 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:19.093 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:19.149 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:19.150 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:19.150 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:19.150 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:20.071 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:20.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:20.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:20.170 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:20.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:20.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:20.222 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:20.231 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:20.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:20.240 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:20.240 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:20.297 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:20.298 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:20.298 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:20.298 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:20.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:20.318 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:20.318 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:20.375 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:20.375 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:20.375 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:20.375 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:21.298 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:21.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:21.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:21.396 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:21.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:21.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:21.448 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:21.457 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:21.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:21.465 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:21.465 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:21.523 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:21.523 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:21.523 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:21.523 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:21.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:21.537 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:21.537 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:21.593 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:21.594 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:21.594 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:21.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:22.524 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:22.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:22.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:22.622 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:22.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:22.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:22.674 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:22.682 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:22.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:22.692 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:22.692 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:22.748 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:22.748 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:22.748 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:22.748 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:22.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:22.763 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:22.763 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:22.821 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:22.822 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:22.822 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:22.822 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:23.749 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:23.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:23.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:23.848 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:23.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:23.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:23.900 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:23.908 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:23.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:23.918 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:23.918 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:23.975 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:23.975 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:23.975 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:23.975 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:23.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:23.980 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:23.980 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:24.038 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:24.039 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:24.039 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:24.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:24.976 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:24.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:24.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:25.074 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:25.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:25.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:25.126 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:25.135 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:25.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:25.144 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:25.144 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:25.202 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:25.202 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:25.202 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:25.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:25.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:25.214 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:25.214 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:25.272 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:25.272 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:25.272 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:25.272 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:26.203 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:26.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:26.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:26.303 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:26.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:26.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:26.355 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:26.363 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:26.373 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:26.373 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:26.373 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:26.429 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:26.430 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:26.430 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:26.430 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:26.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:26.441 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:26.441 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:26.497 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:26.498 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:26.498 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:26.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:27.430 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:27.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:27.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:27.512 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:27.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:27.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:27.564 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:27.572 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:27.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:27.582 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:27.582 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:27.639 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:27.639 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:27.639 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:27.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:27.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:27.660 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:27.660 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:27.718 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:27.718 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:27.718 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:27.718 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:28.640 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:28.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:28.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:28.737 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:28.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:28.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:28.790 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:28.798 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:28.807 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:28.807 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:28.807 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:28.865 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:28.865 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:28.865 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:28.866 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:28.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:28.889 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:28.889 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:28.946 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:28.946 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:28.946 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:28.947 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:29.866 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:29.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:29.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:29.964 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:29.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:29.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:30.016 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:30.025 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:30.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:30.035 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:30.035 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:30.091 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:30.091 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:30.091 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:30.092 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:30.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:30.102 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:30.102 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:30.160 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:30.160 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:30.160 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:30.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:31.092 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:31.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:31.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:31.190 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:31.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:31.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:31.243 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:31.251 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:31.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:31.261 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:31.261 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:31.318 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:31.319 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:31.319 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:31.319 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:31.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:31.325 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:31.325 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:31.382 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:31.382 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:31.382 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:31.383 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:32.320 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:32.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:32.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:32.419 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:32.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:32.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:32.472 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:32.480 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:32.490 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:32.490 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:32.490 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:32.547 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:32.547 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:32.547 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:32.547 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:32.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:32.565 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:32.565 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:32.622 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:32.622 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:32.622 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:32.622 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:33.549 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:33.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:33.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:33.630 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:33.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:33.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:33.682 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:33.690 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:33.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:33.700 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:33.700 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:33.758 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:33.758 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:33.758 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:33.758 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:33.765 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:33.765 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:33.765 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:33.822 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:33.823 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:33.823 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:33.823 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:34.759 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:34.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:34.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:34.857 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:34.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:34.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:34.909 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:34.918 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:34.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:34.927 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:34.927 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:34.985 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:34.985 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:34.985 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:34.985 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:35.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:35.004 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:35.004 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:35.061 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:35.062 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:35.062 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:35.062 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:35.986 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:35.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:35.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:36.087 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:36.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:36.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:36.138 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:36.147 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:36.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:36.156 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:36.156 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:36.213 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:36.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:36.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:36.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:36.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:36.226 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:36.226 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:36.284 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:36.284 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:36.285 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:36.285 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:37.214 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:37.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:37.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:37.291 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:37.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:37.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:37.343 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:37.351 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:37.360 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:37.360 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:37.360 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:37.417 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:37.417 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:37.417 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:37.417 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:37.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:37.437 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:37.437 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:37.495 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:37.495 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:37.495 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:37.496 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:38.418 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:38.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:38.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:38.517 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:38.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:38.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:38.569 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:38.577 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:38.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:38.587 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:38.587 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:38.644 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:38.644 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:38.644 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:38.644 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:38.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:38.669 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:38.669 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:38.726 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:38.727 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:38.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:38.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:39.645 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:39.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:39.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:39.722 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:39.728 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:39.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:39.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:39.790 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:39.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:39.801 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:39.801 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:39.858 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:39.859 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:39.859 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:39.859 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:39.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:39.864 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:39.864 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:39.923 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:39.924 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:39.924 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:39.924 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:40.859 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:40.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:40.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:40.959 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:40.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:40.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:41.011 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:41.020 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:41.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:41.028 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:41.028 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:41.086 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:41.086 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:41.086 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:41.086 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:41.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:41.097 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:41.097 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:41.154 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:41.155 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:41.155 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:41.155 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:42.087 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:42.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:42.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:42.186 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:42.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:42.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:42.238 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:42.246 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:42.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:42.256 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:42.256 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:42.313 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:42.313 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:42.313 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:42.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:42.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:42.328 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:42.329 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:42.386 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:42.386 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:42.386 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:42.386 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:43.314 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:43.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:43.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:43.413 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:43.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:43.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:43.500 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:43.509 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:43.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:43.520 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:43.520 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:43.576 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:43.577 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:43.577 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:43.577 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:43.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:43.598 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:43.598 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:43.654 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:43.654 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:43.654 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:43.654 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:44.578 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:44.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:44.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:44.677 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:44.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:44.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:44.757 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:44.767 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:44.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:44.777 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:44.777 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:44.835 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:44.837 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:44.837 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:44.837 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:44.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:44.845 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:44.845 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:44.901 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:44.901 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:44.901 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:44.901 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:45.839 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:45.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:45.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:45.942 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:45.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:45.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:45.993 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:46.002 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:46.011 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:46.011 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:46.011 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:46.068 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:46.068 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:46.068 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:46.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:46.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:46.085 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:46.085 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:46.142 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:46.142 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:46.143 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:46.143 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:47.069 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:47.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:47.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:47.168 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:47.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:47.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:47.220 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:47.228 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:47.237 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:47.237 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:47.237 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:47.294 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:47.295 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:47.295 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:47.295 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:47.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:47.317 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:47.317 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:47.374 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:47.374 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:47.374 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:47.374 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:48.296 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:48.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:48.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:48.395 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:48.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:48.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:48.447 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:48.455 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:48.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:48.465 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:48.465 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:48.521 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:48.521 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:48.521 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:48.521 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:48.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:48.536 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:48.536 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:48.593 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:48.593 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:48.593 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:48.593 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:49.522 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:49.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:49.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:49.621 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:49.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:49.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:49.674 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:49.683 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:49.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:49.693 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:49.693 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:49.751 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:49.751 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:49.751 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:49.751 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:49.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:49.771 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:49.771 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:49.828 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:49.828 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:49.828 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:49.828 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:50.752 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:50.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:50.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:50.850 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:50.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:50.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:50.903 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:50.911 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:50.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:50.920 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:50.920 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:50.977 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:50.977 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:50.977 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:50.977 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:50.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:50.991 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:50.991 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:51.048 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:51.048 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:51.049 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:51.049 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:51.978 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:51.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:51.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:52.075 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:52.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:52.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:52.127 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:52.135 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:52.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:52.144 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:52.144 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:52.202 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:52.202 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:52.202 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:52.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:52.207 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:52.207 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:52.207 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:52.264 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:52.264 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:52.264 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:52.264 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:53.203 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:53.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:53.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:53.302 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:53.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:53.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:53.354 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:53.363 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:53.373 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:53.373 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:53.373 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:53.430 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:53.430 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:53.430 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:53.430 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:53.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:53.437 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:53.437 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:53.494 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:53.494 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:53.494 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:53.494 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:54.431 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:54.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:54.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:54.513 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:54.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:54.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:54.564 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:54.572 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:54.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:54.581 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:54.581 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:54.638 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:54.638 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:54.638 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:54.638 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:54.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:54.647 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:54.647 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:54.705 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:54.705 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:54.705 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:54.706 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:55.639 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:55.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:55.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:55.739 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:55.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:55.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:55.791 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:55.799 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:55.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:55.809 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:55.809 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:55.865 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:55.865 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:55.866 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:55.866 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:55.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:55.880 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:55.880 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:55.938 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:55.938 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:55.938 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:55.938 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:56.866 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:56.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:56.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:56.965 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:56.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:56.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:57.017 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:57.026 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:57.035 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:57.035 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:57.035 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:57.092 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:57.092 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:57.092 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:57.092 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:57.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:57.107 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:57.108 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:57.165 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:57.165 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:57.165 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:57.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:58.093 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:58.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:58.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:58.191 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:58.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:58.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:58.244 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:58.252 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:58.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:58.262 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:58.262 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:58.319 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:58.319 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:58.319 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:58.319 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:58.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:58.343 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:58.343 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:58.400 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:58.401 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:58.401 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:58.401 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:59.320 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:28:59.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:59.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:59.421 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:28:59.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:59.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:59.473 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:28:59.481 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:28:59.490 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:28:59.490 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:59.491 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:28:59.548 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:59.548 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:59.548 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:59.548 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:28:59.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:28:59.560 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:28:59.560 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:28:59.617 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:59.617 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:28:59.618 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:28:59.618 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:00.549 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:00.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:00.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:00.647 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:00.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:00.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:00.700 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:00.708 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:00.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:00.717 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:00.717 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:00.774 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:00.774 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:00.774 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:00.774 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:00.786 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:00.786 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:00.786 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:00.843 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:00.844 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:00.844 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:00.844 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:01.775 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:01.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:01.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:01.866 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:01.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:01.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:01.918 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:01.926 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:01.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:01.935 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:01.935 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:01.992 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:01.992 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:01.992 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:01.992 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:02.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:02.018 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:02.018 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:02.075 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:02.075 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:02.076 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:02.076 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:02.993 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:02.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:02.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:03.091 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:03.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:03.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:03.143 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:03.152 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:03.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:03.161 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:03.161 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:03.219 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:03.219 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:03.219 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:03.219 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:03.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:03.231 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:03.231 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:03.288 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:03.288 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:03.288 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:03.289 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:04.220 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:04.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:04.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:04.342 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:04.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:04.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:04.351 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:04.403 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:04.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:04.426 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:04.426 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:04.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:04.475 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:04.476 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:04.483 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:04.483 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:04.483 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:04.483 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:04.533 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:04.533 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:04.533 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:04.534 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:05.484 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:05.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:05.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:05.578 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:05.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:05.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:05.630 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:05.639 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:05.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:05.648 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:05.649 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:05.705 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:05.705 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:05.706 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:05.706 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:05.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:05.722 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:05.722 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:05.779 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:05.779 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:05.779 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:05.779 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:06.707 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:06.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:06.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:06.800 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:06.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:06.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:06.851 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:06.859 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:06.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:06.868 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:06.868 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:06.924 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:06.925 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:06.925 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:06.925 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:06.942 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:06.942 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:06.942 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:06.999 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:07.000 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:07.000 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:07.000 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:07.926 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:07.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:07.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:08.026 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:08.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:08.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:08.077 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:08.086 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:08.095 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:08.095 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:08.095 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:08.152 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:08.152 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:08.152 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:08.152 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:08.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:08.168 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:08.168 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:08.225 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:08.225 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:08.225 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:08.225 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:09.153 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:09.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:09.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:09.252 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:09.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:09.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:09.305 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:09.313 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:09.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:09.323 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:09.323 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:09.379 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:09.380 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:09.380 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:09.380 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:09.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:09.398 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:09.398 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:09.456 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:09.456 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:09.456 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:09.456 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:10.381 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:10.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:10.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:10.440 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:10.457 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:10.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:10.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:10.516 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:10.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:10.525 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:10.525 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:10.582 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:10.582 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:10.583 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:10.583 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:10.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:10.592 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:10.592 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:10.648 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:10.649 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:10.649 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:10.649 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:11.584 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:11.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:11.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:11.683 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:11.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:11.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:11.734 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:11.743 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:11.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:11.752 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:11.752 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:11.809 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:11.809 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:11.809 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:11.809 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:11.827 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:11.827 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:11.828 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:11.884 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:11.884 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:11.885 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:11.885 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:12.811 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:12.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:12.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:12.870 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:12.886 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:12.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:12.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:12.945 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:12.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:12.954 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:12.954 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:13.011 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:13.011 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:13.011 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:13.011 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:13.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:13.032 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:13.032 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:13.089 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:13.090 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:13.090 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:13.090 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:14.012 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:14.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:14.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:14.088 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:14.091 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:14.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:14.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:14.157 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:14.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:14.174 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:14.174 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:14.231 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:14.231 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:14.231 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:14.231 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:14.233 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:14.233 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:14.234 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:14.291 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:14.291 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:14.291 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:14.291 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:15.231 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:15.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:15.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:15.293 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:15.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:15.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:15.294 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:15.354 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:15.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:15.383 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:15.383 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:15.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:15.438 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:15.438 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:15.440 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:15.440 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.440 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:15.440 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:15.495 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:15.495 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.495 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:15.496 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:16.441 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:16.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:16.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:16.539 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:16.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:16.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:16.592 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:16.601 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:16.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:16.611 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:16.611 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:16.667 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:16.667 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:16.667 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:16.667 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:16.676 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:16.676 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:16.676 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:16.732 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:16.732 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:16.733 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:16.733 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:17.668 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:17.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:17.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:17.767 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:17.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:17.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:17.820 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:17.828 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:17.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:17.838 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:17.838 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:17.895 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:17.895 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:17.895 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:17.895 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:17.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:17.901 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:17.901 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:17.958 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:17.959 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:17.959 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:17.959 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:18.895 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:18.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:18.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:18.994 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:18.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:18.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:19.047 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:19.055 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:19.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:19.065 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:19.065 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:19.122 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:19.122 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:19.122 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:19.122 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:19.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:19.139 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:19.139 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:19.196 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:19.197 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:19.197 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:19.197 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:20.123 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:20.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:20.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:20.222 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:20.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:20.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:20.275 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:20.283 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:20.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:20.293 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:20.293 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:20.349 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:20.350 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:20.350 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:20.350 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:20.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:20.369 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:20.369 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:20.426 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:20.427 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:20.427 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:20.427 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:21.350 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:21.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:21.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:21.449 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:21.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:21.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:21.502 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:21.511 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:21.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:21.520 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:21.520 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:21.578 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:21.578 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:21.578 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:21.578 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:21.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:21.589 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:21.589 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:21.646 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:21.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:21.647 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:21.647 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:22.579 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:22.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:22.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:22.678 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:22.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:22.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:22.731 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:22.739 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:22.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:22.749 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:22.749 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:22.807 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:22.807 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:22.807 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:22.807 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:22.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:22.830 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:22.830 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:22.887 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:22.888 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:22.888 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:22.888 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:23.808 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:23.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:23.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:23.907 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:23.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:23.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:23.959 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:23.967 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:23.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:23.977 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:23.977 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:24.034 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:24.034 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:24.034 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:24.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:24.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:24.040 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:24.040 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:24.097 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:24.097 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:24.097 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:24.097 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:25.035 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:25.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:25.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:25.135 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:25.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:25.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:25.187 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:25.196 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:25.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:25.205 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:25.205 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:25.262 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:25.262 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:25.262 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:25.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:25.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:25.275 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:25.276 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:25.333 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:25.334 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:25.334 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:25.334 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:26.263 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:26.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:26.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:26.362 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:26.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:26.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:26.414 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:26.423 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:26.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:26.432 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:26.432 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:26.489 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:26.490 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:26.490 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:26.490 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:26.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:26.512 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:26.512 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:26.570 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:26.571 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:26.571 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:26.571 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:27.490 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:27.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:27.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:27.589 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:27.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:27.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:27.642 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:27.650 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:27.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:27.658 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:27.658 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:27.715 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:27.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:27.715 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:27.715 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:27.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:27.727 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:27.727 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:27.785 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:27.786 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:27.786 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:27.786 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:28.716 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:28.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:28.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:28.815 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:28.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:28.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:28.867 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:28.875 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:28.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:28.884 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:28.884 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:28.941 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:28.941 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:28.941 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:28.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:28.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:28.966 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:28.967 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:29.024 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:29.025 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:29.025 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:29.025 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:29.943 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:29.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:29.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:30.042 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:30.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:30.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:30.094 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:30.102 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:30.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:30.153 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:30.153 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:30.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:30.179 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:30.179 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:30.209 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:30.209 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:30.209 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:30.209 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:30.236 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:30.236 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:30.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:30.236 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:31.210 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:31.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:31.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:31.308 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:31.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:31.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:31.361 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:31.369 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:31.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:31.378 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:31.378 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:31.435 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:31.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:31.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:31.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:31.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:31.451 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:31.451 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:31.508 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:31.508 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:31.508 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:31.508 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:32.435 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:32.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:32.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:32.533 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:32.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:32.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:32.585 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:32.594 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:32.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:32.603 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:32.603 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:32.660 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:32.660 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:32.660 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:32.660 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:32.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:32.669 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:32.669 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:32.726 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:32.727 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:32.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:32.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:33.661 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:33.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:33.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:33.759 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:33.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:33.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:33.812 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:33.821 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:33.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:33.829 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:33.830 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:33.886 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:33.886 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:33.886 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:33.886 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:33.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:33.908 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:33.908 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:33.965 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:33.965 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:33.965 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:33.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:34.887 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:34.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:34.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:34.984 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:34.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:34.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:35.037 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:35.045 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:35.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:35.054 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:35.054 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:35.112 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:35.112 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:35.112 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:35.112 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:35.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:35.121 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:35.121 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:35.178 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:35.179 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:35.179 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:35.179 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:36.113 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:36.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:36.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:36.211 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:36.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:36.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:36.263 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:36.272 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:36.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:36.281 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:36.281 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:36.338 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:36.339 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:36.339 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:36.339 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:36.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:36.353 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:36.354 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:36.410 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:36.411 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:36.411 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:36.411 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:37.339 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:37.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:37.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:37.436 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:37.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:37.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:37.488 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:37.496 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:37.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:37.505 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:37.505 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:37.563 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:37.563 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:37.563 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:37.564 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:37.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:37.578 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:37.578 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:37.635 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:37.635 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:37.636 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:37.636 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:38.564 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:38.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:38.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:38.663 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:38.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:38.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:38.714 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:38.722 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:38.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:38.773 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:38.773 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:38.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:38.797 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:38.797 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:38.830 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:38.831 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:38.831 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:38.831 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:38.854 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:38.854 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:38.854 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:38.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:39.833 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:39.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:39.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:39.932 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:39.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:39.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:39.984 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:39.992 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:40.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:40.002 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:40.002 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:40.059 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:40.059 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:40.059 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:40.059 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:40.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:40.071 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:40.071 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:40.128 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:40.128 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:40.128 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:40.128 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:41.060 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:41.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:41.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:41.158 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:41.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:41.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:41.212 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:41.221 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:41.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:41.230 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:41.230 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:41.287 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:41.287 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:41.287 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:41.287 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:41.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:41.295 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:41.295 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:41.352 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:41.352 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:41.352 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:41.352 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:42.287 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:42.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:42.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:42.381 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:42.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:42.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:42.433 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:42.442 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:42.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:42.451 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:42.451 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:42.508 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:42.508 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:42.508 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:42.508 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:42.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:42.517 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:42.517 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:42.574 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:42.574 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:42.574 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:42.574 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:43.509 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:43.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:43.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:43.602 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:43.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:43.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:43.654 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:43.662 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:43.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:43.671 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:43.671 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:43.728 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:43.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:43.728 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:43.728 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:43.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:43.735 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:43.735 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:43.793 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:43.793 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:43.793 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:43.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:44.729 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:44.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:44.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:44.804 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:44.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:44.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:44.855 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:44.863 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:44.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:44.912 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:44.912 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:44.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:44.938 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:44.938 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:44.969 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:44.969 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:44.969 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:44.969 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:44.995 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:44.995 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:44.995 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:44.995 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:45.970 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:45.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:45.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:46.071 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:46.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:46.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:46.124 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:46.132 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:46.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:46.141 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:46.141 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:46.197 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:46.198 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:46.198 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:46.198 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:46.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:46.215 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:46.215 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:46.272 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:46.277 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:46.277 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:46.277 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:47.199 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:47.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:47.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:47.298 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:47.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:47.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:47.350 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:47.359 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:47.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:47.369 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:47.369 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:47.426 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:47.426 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:47.426 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:47.426 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:47.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:47.437 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:47.437 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:47.494 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:47.495 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:47.495 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:47.495 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:48.427 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:48.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:48.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:48.527 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:48.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:48.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:48.580 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:48.589 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:48.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:48.598 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:48.599 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:48.656 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:48.656 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:48.656 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:48.656 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:48.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:48.662 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:48.662 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:48.720 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:48.720 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:48.720 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:48.720 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:49.657 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:49.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:49.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:49.756 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:49.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:49.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:49.809 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:49.817 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:49.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:49.826 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:49.826 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:49.883 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:49.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:49.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:49.883 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:49.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:49.890 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:49.890 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:49.948 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:49.948 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:49.948 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:49.949 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:50.884 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:50.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:50.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:50.983 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:50.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:50.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:51.036 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:51.044 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:51.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:51.053 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:51.053 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:51.110 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:51.110 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:51.110 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:51.110 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:51.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:51.122 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:51.122 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:51.179 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:51.179 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:51.179 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:51.179 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:52.111 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:52.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:52.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:52.211 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:52.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:52.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:52.262 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:52.271 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:52.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:52.280 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:52.280 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:52.337 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:52.337 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:52.337 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:52.337 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:52.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:52.355 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:52.355 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:52.413 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:52.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:52.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:52.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:53.338 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:53.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:53.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:53.438 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:53.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:53.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:53.501 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:53.510 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:53.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:53.521 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:53.521 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:53.579 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:53.579 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:53.579 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:53.579 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:53.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:53.590 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:53.590 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:53.647 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:53.647 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:53.647 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:53.647 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:54.580 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:54.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:54.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:54.679 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:54.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:54.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:54.731 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:54.740 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:54.750 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:54.750 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:54.750 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:54.807 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:54.807 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:54.807 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:54.807 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:54.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:54.822 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:54.822 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:54.879 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:54.880 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:54.880 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:54.880 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:55.808 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:55.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:55.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:55.906 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:55.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:55.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:55.959 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:55.967 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:55.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:55.976 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:55.976 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:56.033 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:56.033 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:56.033 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:56.033 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:56.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:56.046 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:56.046 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:56.103 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:56.103 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:56.103 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:56.104 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:57.034 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:57.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:57.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:57.134 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:57.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:57.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:57.187 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:57.195 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:57.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:57.204 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:57.204 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:57.260 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:57.260 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:57.261 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:57.261 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:57.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:57.271 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:57.271 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:57.328 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:57.329 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:57.329 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:57.329 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:58.262 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:58.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:58.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:58.361 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:58.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:58.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:58.414 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:58.423 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:58.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:58.431 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:58.431 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:58.488 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:58.488 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:58.488 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:58.488 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:58.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:58.503 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:58.503 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:58.560 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:58.561 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:58.561 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:58.561 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:59.490 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:59.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:59.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:59.588 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:59.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:59.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:59.640 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:29:59.648 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:29:59.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:29:59.658 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:59.658 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:29:59.715 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:59.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:59.715 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:59.715 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:59.731 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:29:59.731 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:59.731 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:29:59.790 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:59.791 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:59.791 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:59.791 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:00.716 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:00.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:00.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:00.814 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:00.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:00.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:00.824 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:30:00.876 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:30:00.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:00.901 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:00.901 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:30:00.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:00.954 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:00.954 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:30:00.958 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:00.958 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:00.958 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:00.958 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:01.012 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:01.012 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:01.012 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:01.012 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:01.959 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:01.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:01.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:02.021 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:02.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:02.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:02.030 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:30:02.082 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:30:02.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:02.106 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:02.106 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:30:02.163 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:02.163 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:02.163 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:02.163 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:02.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:02.167 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:02.167 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:30:02.224 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:02.224 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:02.224 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:02.224 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:03.164 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:03.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:03.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:03.263 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:03.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:03.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:03.315 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:30:03.324 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:30:03.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:03.334 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:03.334 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:30:03.390 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:03.391 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:03.391 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:03.391 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:03.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:03.398 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:03.398 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:30:03.456 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:03.457 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:03.457 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:03.457 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:04.391 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:04.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:04.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:04.490 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:04.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:04.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:04.542 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:30:04.551 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:30:04.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:04.560 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:04.560 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:30:04.616 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:04.617 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:04.617 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:04.617 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:04.636 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:04.636 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:04.636 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:30:04.694 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:04.694 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:04.694 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:04.695 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:05.617 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:05.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:05.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:05.717 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:05.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:05.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:05.770 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:30:05.778 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:30:05.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:05.788 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:05.788 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:30:05.845 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:05.845 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:05.845 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:05.845 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:05.857 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:05.857 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:05.858 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:30:05.915 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:05.916 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:05.916 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:05.916 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:06.846 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:06.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:06.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:06.943 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:06.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:06.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:06.996 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:30:07.004 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:30:07.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:07.013 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:07.013 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:30:07.069 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:07.069 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:07.069 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:07.069 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:07.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:07.093 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:07.093 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:30:07.150 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:07.151 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:07.151 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:07.151 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:08.070 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:08.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:08.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:08.169 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:08.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:08.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:08.222 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:30:08.231 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:30:08.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:08.240 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:08.240 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:30:08.297 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:08.297 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:08.297 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:08.297 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:08.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:08.307 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:08.307 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:30:08.365 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:08.365 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:08.365 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:08.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:09.298 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:09.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:09.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:09.396 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:09.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:09.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:09.448 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:30:09.456 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:30:09.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:09.465 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:09.465 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:30:09.521 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:09.522 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:09.522 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:09.522 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:09.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:09.531 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:09.531 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:30:09.589 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:09.590 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:09.590 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:09.590 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:10.522 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:10.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:10.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:10.621 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:10.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:10.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:10.674 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:30:10.683 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:30:10.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:10.691 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:10.691 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:30:10.747 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:10.748 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:10.748 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:10.748 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:10.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:10.770 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:10.770 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:30:10.827 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:10.827 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:10.827 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:10.827 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:11.748 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:11.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:11.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:11.847 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:11.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:11.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:11.899 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:30:11.908 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:30:11.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:11.916 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:11.916 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:30:11.972 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:11.973 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:11.973 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:11.973 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:11.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:11.989 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:11.989 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:30:12.047 INFO:teuthology.orchestra.run.trial131.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:12.047 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:12.047 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:12.048 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:12.974 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:12.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:12.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:13.033 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T22:30:13.049 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:13.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:13.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:13.116 DEBUG:teuthology.orchestra.run.trial131:> true 2026-02-12T22:30:13.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T22:30:13.124 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:13.124 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T22:30:13.180 INFO:teuthology.orchestra.run.trial048.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:13.181 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:13.181 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:13.181 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:13.181 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:13.182 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:30:13.199 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:30:13.235 INFO:teuthology.run:Summary data: description: fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds_creation_retry} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:30:13.235 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:30:13.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial131.front.sepia.ceph.com' 2026-02-12T22:30:13.322 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:13.322 DEBUG:teuthology.orchestra.run.trial131:> uname -r 2026-02-12T22:30:13.359 INFO:teuthology.run:FAIL